Sep 14 09:43:02.455286 ip-10-0-132-247 systemd[1]: Starting Kubernetes Kubelet...
Sep 14 09:43:02.890868 ip-10-0-132-247 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 14 09:43:02.890868 ip-10-0-132-247 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 14 09:43:02.890868 ip-10-0-132-247 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 14 09:43:02.890868 ip-10-0-132-247 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 14 09:43:02.890868 ip-10-0-132-247 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 14 09:43:02.891804 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.891715    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 14 09:43:02.897631 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897612    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 09:43:02.897631 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897630    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 09:43:02.897702 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897634    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 09:43:02.897702 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897637    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 09:43:02.897702 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897642    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 09:43:02.897702 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897647    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 09:43:02.897702 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897651    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 09:43:02.897702 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897654    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 09:43:02.897702 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897657    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 09:43:02.897702 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897660    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 09:43:02.897702 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897664    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 09:43:02.897702 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897667    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 09:43:02.897702 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897670    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 09:43:02.897702 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897673    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 09:43:02.897702 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897676    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 09:43:02.897702 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897679    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 09:43:02.897702 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897682    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 09:43:02.897702 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897685    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 09:43:02.897702 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897688    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 09:43:02.897702 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897695    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 09:43:02.897702 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897698    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 09:43:02.898211 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897700    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 09:43:02.898211 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897703    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 09:43:02.898211 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897706    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 09:43:02.898211 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897709    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 09:43:02.898211 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897712    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 09:43:02.898211 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897715    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 09:43:02.898211 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897718    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 09:43:02.898211 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897721    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 09:43:02.898211 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897723    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 09:43:02.898211 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897727    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 09:43:02.898211 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897729    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 09:43:02.898211 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897732    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 09:43:02.898211 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897735    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 09:43:02.898211 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897737    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 09:43:02.898211 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897740    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 09:43:02.898211 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897743    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 09:43:02.898211 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897745    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 09:43:02.898211 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897749    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 09:43:02.898211 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897752    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 09:43:02.898211 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897756    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 09:43:02.898699 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897760    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 09:43:02.898699 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897763    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 09:43:02.898699 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897766    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 09:43:02.898699 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897768    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 09:43:02.898699 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897772    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 09:43:02.898699 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897776    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 09:43:02.898699 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897778    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 09:43:02.898699 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897781    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 09:43:02.898699 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897783    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 09:43:02.898699 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897786    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 09:43:02.898699 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897789    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 09:43:02.898699 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897791    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 09:43:02.898699 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897794    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 09:43:02.898699 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897797    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 09:43:02.898699 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897800    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 09:43:02.898699 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897803    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 09:43:02.898699 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897806    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 09:43:02.898699 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897808    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 09:43:02.898699 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897811    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 09:43:02.898699 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897813    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 09:43:02.899197 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897817    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 09:43:02.899197 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897820    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 09:43:02.899197 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897823    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 09:43:02.899197 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897826    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 09:43:02.899197 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897829    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 09:43:02.899197 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897831    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 09:43:02.899197 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897834    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 09:43:02.899197 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897836    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 09:43:02.899197 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897839    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 09:43:02.899197 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897841    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 09:43:02.899197 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897844    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 09:43:02.899197 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897847    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 09:43:02.899197 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897849    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 09:43:02.899197 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897852    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 09:43:02.899197 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897854    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 09:43:02.899197 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897857    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 09:43:02.899197 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897859    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 09:43:02.899197 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897863    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 09:43:02.899197 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897865    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 09:43:02.899197 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897868    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 09:43:02.899681 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897871    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 09:43:02.899681 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897873    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 09:43:02.899681 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897876    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 09:43:02.899681 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897879    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 09:43:02.899681 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897881    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 09:43:02.899681 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897884    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 09:43:02.899681 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897887    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 09:43:02.899681 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897889    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 09:43:02.899681 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897892    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 09:43:02.899681 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897895    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 09:43:02.899681 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897897    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 09:43:02.899681 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897899    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 09:43:02.899681 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897902    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 09:43:02.899681 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897906    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 09:43:02.899681 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897910    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 09:43:02.899681 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897913    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 09:43:02.899681 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897916    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 09:43:02.899681 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.897918    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 09:43:02.899681 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898644    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 09:43:02.900177 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898652    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 09:43:02.900177 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898657    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 09:43:02.900177 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898660    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 09:43:02.900177 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898663    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 09:43:02.900177 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898666    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 09:43:02.900177 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898669    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 09:43:02.900177 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898672    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 09:43:02.900177 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898674    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 09:43:02.900177 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898677    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 09:43:02.900177 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898680    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 09:43:02.900177 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898682    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 09:43:02.900177 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898685    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 09:43:02.900177 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898688    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 09:43:02.900177 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898691    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 09:43:02.900177 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898693    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 09:43:02.900177 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898696    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 09:43:02.900177 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898698    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 09:43:02.900177 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898701    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 09:43:02.900177 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898704    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 09:43:02.900664 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898707    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 09:43:02.900664 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898710    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 09:43:02.900664 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898713    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 09:43:02.900664 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898716    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 09:43:02.900664 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898718    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 09:43:02.900664 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898721    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 09:43:02.900664 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898724    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 09:43:02.900664 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898728    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 09:43:02.900664 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898731    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 09:43:02.900664 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898734    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 09:43:02.900664 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898737    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 09:43:02.900664 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898740    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 09:43:02.900664 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898744    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 09:43:02.900664 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898747    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 09:43:02.900664 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898749    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 09:43:02.900664 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898752    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 09:43:02.900664 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898755    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 09:43:02.900664 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898757    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 09:43:02.900664 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898759    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 09:43:02.900664 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898762    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 09:43:02.901162 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898764    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 09:43:02.901162 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898767    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 09:43:02.901162 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898769    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 09:43:02.901162 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898772    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 09:43:02.901162 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898774    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 09:43:02.901162 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898777    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 09:43:02.901162 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898780    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 09:43:02.901162 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898783    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 09:43:02.901162 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898785    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 09:43:02.901162 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898788    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 09:43:02.901162 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898791    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 09:43:02.901162 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898796    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 09:43:02.901162 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898799    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 09:43:02.901162 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898801    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 09:43:02.901162 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898803    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 09:43:02.901162 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898806    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 09:43:02.901162 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898809    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 09:43:02.901162 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898812    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 09:43:02.901162 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898814    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 09:43:02.901636 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898817    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 09:43:02.901636 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898819    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 09:43:02.901636 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898821    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 09:43:02.901636 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898824    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 09:43:02.901636 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898827    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 09:43:02.901636 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898830    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 09:43:02.901636 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898832    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 09:43:02.901636 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898835    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 09:43:02.901636 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898837    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 09:43:02.901636 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898840    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 09:43:02.901636 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898842    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 09:43:02.901636 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898845    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 09:43:02.901636 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898847    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 09:43:02.901636 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898850    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 09:43:02.901636 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898852    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 09:43:02.901636 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898854    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 09:43:02.901636 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898857    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 09:43:02.901636 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898860    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 09:43:02.901636 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898862    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 09:43:02.901636 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898864    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 09:43:02.902134 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898867    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 09:43:02.902134 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898870    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 09:43:02.902134 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898872    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 09:43:02.902134 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898875    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 09:43:02.902134 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898878    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 09:43:02.902134 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898880    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 09:43:02.902134 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898883    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 09:43:02.902134 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898885    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 09:43:02.902134 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898888    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 09:43:02.902134 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898891    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 09:43:02.902134 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898894    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 09:43:02.902134 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898896    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 09:43:02.902134 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898899    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 09:43:02.902134 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898901    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 09:43:02.902134 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898904    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 09:43:02.902134 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898906    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 09:43:02.902134 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898909    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 09:43:02.902134 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898911    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 09:43:02.902134 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898914    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 09:43:02.902134 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.898916    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 09:43:02.902619 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899323    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 09:43:02.902619 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899328    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 09:43:02.902619 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899331    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 09:43:02.902619 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899333    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 09:43:02.902619 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899336    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 09:43:02.902619 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899339    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 09:43:02.902619 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899341    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 09:43:02.902619 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899344    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 09:43:02.902619 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899347    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 09:43:02.902619 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899349    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 09:43:02.902619 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899352    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 09:43:02.902619 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899355    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 09:43:02.902619 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899358    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 09:43:02.902619 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899363    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 09:43:02.902619 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899367    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 09:43:02.902619 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899369    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 09:43:02.902619 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899372    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 09:43:02.902619 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899377    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 09:43:02.902619 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899381    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 09:43:02.903086 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899384    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 09:43:02.903086 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899387    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 09:43:02.903086 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899390    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 09:43:02.903086 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899393    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 09:43:02.903086 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899396    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 09:43:02.903086 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899398    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 09:43:02.903086 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899401    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 09:43:02.903086 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899403    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 09:43:02.903086 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899406    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 09:43:02.903086 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899408    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 09:43:02.903086 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899411    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 09:43:02.903086 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899413    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 09:43:02.903086 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899416    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 09:43:02.903086 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899418    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 09:43:02.903086 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899421    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 09:43:02.903086 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899423    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 09:43:02.903086 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899426    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 09:43:02.903086 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899428    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 09:43:02.903086 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899431    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 09:43:02.903086 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899435    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 09:43:02.903562 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899437    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 09:43:02.903562 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899440    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 09:43:02.903562 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899442    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 09:43:02.903562 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899445    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 09:43:02.903562 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899447    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 09:43:02.903562 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899450    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 09:43:02.903562 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899453    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 09:43:02.903562 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899456    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 09:43:02.903562 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899458    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 09:43:02.903562 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899461    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 09:43:02.903562 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899464    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 09:43:02.903562 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899466    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 09:43:02.903562 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899470    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 09:43:02.903562 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899472    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 09:43:02.903562 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899475    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 09:43:02.903562 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899478    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 09:43:02.903562 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899480    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 09:43:02.903562 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899483    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 09:43:02.903562 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899485    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 09:43:02.903562 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899488    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 09:43:02.904076 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899490    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 09:43:02.904076 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899493    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 09:43:02.904076 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899495    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 09:43:02.904076 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899498    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 09:43:02.904076 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899500    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 09:43:02.904076 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899503    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 09:43:02.904076 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899505    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 09:43:02.904076 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899508    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 09:43:02.904076 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899510    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 09:43:02.904076 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899513    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 09:43:02.904076 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899515    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 09:43:02.904076 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899518    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 09:43:02.904076 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899520    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 09:43:02.904076 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899522    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 09:43:02.904076 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899525    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 09:43:02.904076 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899532    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 09:43:02.904076 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899535    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 09:43:02.904076 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899538    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 09:43:02.904076 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899541    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 09:43:02.904076 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899544    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 09:43:02.904576 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899546    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 09:43:02.904576 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899549    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 09:43:02.904576 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899552    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 09:43:02.904576 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899554    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 09:43:02.904576 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899557    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 09:43:02.904576 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899559    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 09:43:02.904576 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899562    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 09:43:02.904576 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899565    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 09:43:02.904576 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899568    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 09:43:02.904576 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899570    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 09:43:02.904576 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899573    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 09:43:02.904576 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899575    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 09:43:02.904576 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899577    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 09:43:02.904576 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899580    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 09:43:02.904576 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899582    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 09:43:02.904576 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899585    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 09:43:02.904576 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899587    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 09:43:02.904576 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899590    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 09:43:02.904576 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899593    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 09:43:02.904576 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.899595    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899675    2581 flags.go:64] FLAG: --address="0.0.0.0"
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899707    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899715    2581 flags.go:64] FLAG: --anonymous-auth="true"
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899720    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899724    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899727    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899732    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899737    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899740    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899744    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899747    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899750    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899754    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899757    2581 flags.go:64] FLAG: --cgroup-root=""
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899760    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899763    2581 flags.go:64] FLAG: --client-ca-file=""
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899766    2581 flags.go:64] FLAG: --cloud-provider="external"
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899769    2581 flags.go:64] FLAG: --cluster-dns="[]"
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899775    2581 flags.go:64] FLAG: --cluster-domain=""
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899778    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899781    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899784    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899787    2581 flags.go:64] FLAG: --container-log-max-files="5"
Sep 14 09:43:02.905083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899791    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899794    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899797    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899801    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899804    2581 flags.go:64] FLAG: --contention-profiling="false"
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899807    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899810    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899813    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899816    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899820    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899823    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899826    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899828    2581 flags.go:64] FLAG: --enable-load-reader="false"
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899831    2581 flags.go:64] FLAG: --enable-server="true"
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899834    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899839    2581 flags.go:64] FLAG: --event-burst="100"
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899843    2581 flags.go:64] FLAG: --event-qps="50"
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899846    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899849    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899852    2581 flags.go:64] FLAG: --eviction-hard=""
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899856    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899859    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899863    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899866    2581 flags.go:64] FLAG: --eviction-soft=""
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899869    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 14 09:43:02.905648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899872    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899875    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899879    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899882    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899885    2581 flags.go:64] FLAG: --fail-swap-on="true"
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899888    2581 flags.go:64] FLAG: --feature-gates=""
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899892    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899895    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899898    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899901    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899904    2581 flags.go:64] FLAG: --healthz-port="10248"
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899907    2581 flags.go:64] FLAG: --help="false"
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899910    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-132-247.ec2.internal"
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899913    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899916    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899919    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899922    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899926    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899928    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899931    2581 flags.go:64] FLAG: --image-service-endpoint=""
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899934    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899937    2581 flags.go:64] FLAG: --kube-api-burst="100"
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899940    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899944    2581 flags.go:64] FLAG: --kube-api-qps="50"
Sep 14 09:43:02.906337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899947    2581 flags.go:64] FLAG: --kube-reserved=""
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899950    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899953    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899956    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899958    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899961    2581 flags.go:64] FLAG: --lock-file=""
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899977    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899981    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899984    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899990    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899994    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.899997    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900000    2581 flags.go:64] FLAG: --logging-format="text"
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900003    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900006    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900009    2581 flags.go:64] FLAG: --manifest-url=""
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900012    2581 flags.go:64] FLAG: --manifest-url-header=""
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900016    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900020    2581 flags.go:64] FLAG: --max-open-files="1000000"
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900024    2581 flags.go:64] FLAG: --max-pods="110"
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900027    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900030    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900033    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900042    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900046    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 14 09:43:02.906918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900049    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900052    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900061    2581 flags.go:64] FLAG: --node-status-max-images="50"
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900064    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900067    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900070    2581 flags.go:64] FLAG: --pod-cidr=""
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900074    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900080    2581 flags.go:64] FLAG: --pod-manifest-path=""
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900083    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900086    2581 flags.go:64] FLAG: --pods-per-core="0"
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900089    2581 flags.go:64] FLAG: --port="10250"
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900092    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900095    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00122232c7a6e25df"
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900098    2581 flags.go:64] FLAG: --qos-reserved=""
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900102    2581 flags.go:64] FLAG: --read-only-port="10255"
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900105    2581 flags.go:64] FLAG: --register-node="true"
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900108    2581 flags.go:64] FLAG: --register-with-taints=""
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900113    2581 flags.go:64] FLAG: --registry-burst="10"
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900116    2581 flags.go:64] FLAG: --registry-qps="5"
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900119    2581 flags.go:64] FLAG: --reserved-cpus=""
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900122    2581 flags.go:64] FLAG: --reserved-memory=""
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900126    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900129    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900132    2581 flags.go:64] FLAG: --rotate-certificates="false"
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900135    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 14 09:43:02.907536 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900138    2581 flags.go:64] FLAG: --runonce="false"
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900141    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900144    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900147    2581 flags.go:64] FLAG: --seccomp-default="false"
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900150    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900153    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900156    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900160    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900163    2581 flags.go:64] FLAG: --storage-driver-password="root"
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900166    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900169    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900171    2581 flags.go:64] FLAG: --storage-driver-user="root"
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900174    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900177    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900181    2581 flags.go:64] FLAG: --system-cgroups=""
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900184    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900190    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900193    2581 flags.go:64] FLAG: --tls-cert-file=""
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900196    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900200    2581 flags.go:64] FLAG: --tls-min-version=""
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900203    2581 flags.go:64] FLAG: --tls-private-key-file=""
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900205    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900209    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900212    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900216    2581 flags.go:64] FLAG: --v="2"
Sep 14 09:43:02.908274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900220    2581 flags.go:64] FLAG: --version="false"
Sep 14 09:43:02.908994 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900225    2581 flags.go:64] FLAG: --vmodule=""
Sep 14 09:43:02.908994 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900228    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 14 09:43:02.908994 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900232    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 14 09:43:02.908994 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900374    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 09:43:02.908994 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900379    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 09:43:02.908994 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900382    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 09:43:02.908994 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900386    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 09:43:02.908994 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900389    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 09:43:02.908994 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900392    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 09:43:02.908994 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900394    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 09:43:02.908994 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900397    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 09:43:02.908994 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900400    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 09:43:02.908994 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900402    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 09:43:02.908994 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900405    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 09:43:02.908994 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900408    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 09:43:02.908994 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900410    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 09:43:02.908994 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900413    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 09:43:02.908994 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900416    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 09:43:02.908994 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900418    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 09:43:02.908994 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900421    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 09:43:02.909705 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900425    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 09:43:02.909705 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900428    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 09:43:02.909705 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900430    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 09:43:02.909705 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900433    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 09:43:02.909705 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900436    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 09:43:02.909705 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900439    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 09:43:02.909705 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900441    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 09:43:02.909705 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900444    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 09:43:02.909705 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900446    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 09:43:02.909705 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900449    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 09:43:02.909705 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900453    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 09:43:02.909705 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900456    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 09:43:02.909705 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900459    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 09:43:02.909705 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900461    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 09:43:02.909705 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900464    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 09:43:02.909705 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900467    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 09:43:02.909705 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900469    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 09:43:02.909705 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900472    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 09:43:02.909705 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900474    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 09:43:02.909705 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900477    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 09:43:02.910400 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900479    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 09:43:02.910400 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900482    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 09:43:02.910400 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900484    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 09:43:02.910400 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900487    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 09:43:02.910400 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900490    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 09:43:02.910400 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900492    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 09:43:02.910400 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900495    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 09:43:02.910400 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900498    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 09:43:02.910400 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900500    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 09:43:02.910400 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900503    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 09:43:02.910400 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900505    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 09:43:02.910400 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900508    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 09:43:02.910400 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900511    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 09:43:02.910400 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900514    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 09:43:02.910400 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900517    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 09:43:02.910400 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900519    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 09:43:02.910400 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900522    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 09:43:02.910400 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900525    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 09:43:02.910400 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900528    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 09:43:02.911058 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900530    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 09:43:02.911058 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900533    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 09:43:02.911058 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900536    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 09:43:02.911058 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900543    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 09:43:02.911058 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900547    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 09:43:02.911058 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900549    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 09:43:02.911058 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900552    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 09:43:02.911058 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900555    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 09:43:02.911058 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900557    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 09:43:02.911058 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900559    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 09:43:02.911058 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900562    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 09:43:02.911058 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900572    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 09:43:02.911058 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900575    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 09:43:02.911058 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900578    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 09:43:02.911058 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900580    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 09:43:02.911058 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900583    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 09:43:02.911058 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900585    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 09:43:02.911058 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900588    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 09:43:02.911058 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900591    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 09:43:02.911058 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900594    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 09:43:02.911566 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900597    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 09:43:02.911566 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900599    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 09:43:02.911566 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900602    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 09:43:02.911566 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900605    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 09:43:02.911566 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900608    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 09:43:02.911566 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900612    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 09:43:02.911566 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900615    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 09:43:02.911566 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900617    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 09:43:02.911566 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900620    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 09:43:02.911566 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900623    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 09:43:02.911566 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900626    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 09:43:02.911566 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900628    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 09:43:02.911566 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900631    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 09:43:02.911566 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900633    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 09:43:02.911566 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900636    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 09:43:02.911566 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900639    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 09:43:02.911566 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900642    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 09:43:02.911566 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900646    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 09:43:02.911566 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900651    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 09:43:02.912121 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900654    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 09:43:02.912121 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900657    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 09:43:02.912121 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900660    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 09:43:02.912121 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.900663    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 09:43:02.912121 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.900668    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 14 09:43:02.912121 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.911412    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 14 09:43:02.912121 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.911429    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 14 09:43:02.912121 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.911450    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 14 09:43:02.912121 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.911456    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 14 09:43:02.912121 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911522    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 09:43:02.912121 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911528    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 09:43:02.912121 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911531    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 09:43:02.912121 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911536    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 09:43:02.912121 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911540    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 09:43:02.912470 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911543    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 09:43:02.912470 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911546    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 09:43:02.912470 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911550    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 09:43:02.912470 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911553    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 09:43:02.912470 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911555    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 09:43:02.912470 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911558    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 09:43:02.912470 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911561    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 09:43:02.912470 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911564    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 09:43:02.912470 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911567    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 09:43:02.912470 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911570    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 09:43:02.912470 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911573    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 09:43:02.912470 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911576    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 09:43:02.912470 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911579    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 09:43:02.912470 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911582    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 09:43:02.912470 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911584    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 09:43:02.912470 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911587    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 09:43:02.912470 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911590    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 09:43:02.912470 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911593    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 09:43:02.912470 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911596    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 09:43:02.912470 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911599    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 09:43:02.912961 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911602    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 09:43:02.912961 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911605    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 09:43:02.912961 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911608    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 09:43:02.912961 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911612    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 09:43:02.912961 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911615    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 09:43:02.912961 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911619    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 09:43:02.912961 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911622    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 09:43:02.912961 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911625    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 09:43:02.912961 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911628    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 09:43:02.912961 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911631    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 09:43:02.912961 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911634    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 09:43:02.912961 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911636    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 09:43:02.912961 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911639    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 09:43:02.912961 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911642    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 09:43:02.912961 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911644    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 09:43:02.912961 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911647    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 09:43:02.912961 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911649    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 09:43:02.912961 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911653    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 09:43:02.912961 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911656    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 09:43:02.913437 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911658    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 09:43:02.913437 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911661    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 09:43:02.913437 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911664    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 09:43:02.913437 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911666    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 09:43:02.913437 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911669    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 09:43:02.913437 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911671    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 09:43:02.913437 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911674    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 09:43:02.913437 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911677    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 09:43:02.913437 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911680    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 09:43:02.913437 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911682    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 09:43:02.913437 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911685    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 09:43:02.913437 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911688    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 09:43:02.913437 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911690    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 09:43:02.913437 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911693    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 09:43:02.913437 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911696    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 09:43:02.913437 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911699    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 09:43:02.913437 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911701    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 09:43:02.913437 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911704    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 09:43:02.913437 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911706    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 09:43:02.913437 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911709    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 09:43:02.913954 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911712    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 09:43:02.913954 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911714    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 09:43:02.913954 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911717    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 09:43:02.913954 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911719    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 09:43:02.913954 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911722    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 09:43:02.913954 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911725    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 09:43:02.913954 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911727    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 09:43:02.913954 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911730    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 09:43:02.913954 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911732    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 09:43:02.913954 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911735    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 09:43:02.913954 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911738    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 09:43:02.913954 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911740    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 09:43:02.913954 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911743    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 09:43:02.913954 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911746    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 09:43:02.913954 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911748    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 09:43:02.913954 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911757    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 09:43:02.913954 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911760    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 09:43:02.913954 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911762    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 09:43:02.913954 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911765    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 09:43:02.913954 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911768    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 09:43:02.914461 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911770    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 09:43:02.914461 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911772    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 09:43:02.914461 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911775    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 09:43:02.914461 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911778    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 09:43:02.914461 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911780    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 09:43:02.914461 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911783    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 09:43:02.914461 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911785    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 09:43:02.914461 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911788    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 09:43:02.914461 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911790    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 09:43:02.914461 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911793    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 09:43:02.914461 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911796    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 09:43:02.914461 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911798    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 09:43:02.914461 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911801    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 09:43:02.914461 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911803    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 09:43:02.914461 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911806    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 09:43:02.914820 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.911811    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 14 09:43:02.914820 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911944    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 14 09:43:02.914820 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911949    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 14 09:43:02.914820 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911952    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 14 09:43:02.914820 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911955    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 14 09:43:02.914820 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911958    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 14 09:43:02.914820 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911961    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 14 09:43:02.914820 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911963    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 14 09:43:02.914820 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911993    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 14 09:43:02.914820 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911996    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 14 09:43:02.914820 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.911999    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 14 09:43:02.914820 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912002    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 14 09:43:02.914820 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912004    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 14 09:43:02.914820 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912014    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 14 09:43:02.914820 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912017    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 14 09:43:02.915231 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912020    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 14 09:43:02.915231 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912022    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 14 09:43:02.915231 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912026    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 14 09:43:02.915231 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912028    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 14 09:43:02.915231 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912031    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 14 09:43:02.915231 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912033    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 14 09:43:02.915231 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912042    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 14 09:43:02.915231 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912045    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 14 09:43:02.915231 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912048    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 14 09:43:02.915231 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912050    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 14 09:43:02.915231 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912053    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 14 09:43:02.915231 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912056    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 14 09:43:02.915231 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912059    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 14 09:43:02.915231 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912061    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 14 09:43:02.915231 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912064    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 14 09:43:02.915231 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912066    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 14 09:43:02.915231 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912069    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 14 09:43:02.915231 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912072    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 14 09:43:02.915231 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912074    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 14 09:43:02.915734 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912077    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 14 09:43:02.915734 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912079    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 14 09:43:02.915734 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912082    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 14 09:43:02.915734 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912086    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 14 09:43:02.915734 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912090    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 14 09:43:02.915734 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912093    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 14 09:43:02.915734 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912096    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 14 09:43:02.915734 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912098    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 14 09:43:02.915734 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912101    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 14 09:43:02.915734 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912104    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 14 09:43:02.915734 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912106    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 14 09:43:02.915734 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912109    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 14 09:43:02.915734 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912120    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 14 09:43:02.915734 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912123    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 14 09:43:02.915734 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912126    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 14 09:43:02.915734 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912129    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 14 09:43:02.915734 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912131    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 14 09:43:02.915734 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912134    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 14 09:43:02.915734 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912136    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 14 09:43:02.916300 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912139    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 14 09:43:02.916300 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912142    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 14 09:43:02.916300 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912144    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 14 09:43:02.916300 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912147    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 14 09:43:02.916300 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912149    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 14 09:43:02.916300 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912154    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 14 09:43:02.916300 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912157    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 14 09:43:02.916300 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912159    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 14 09:43:02.916300 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912162    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 14 09:43:02.916300 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912165    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 14 09:43:02.916300 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912167    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 14 09:43:02.916300 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912170    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 14 09:43:02.916300 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912172    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 14 09:43:02.916300 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912175    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 14 09:43:02.916300 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912178    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 14 09:43:02.916300 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912181    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 14 09:43:02.916300 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912183    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 14 09:43:02.916300 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912186    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 14 09:43:02.916300 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912189    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 14 09:43:02.916300 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912191    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 14 09:43:02.916795 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912195    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 14 09:43:02.916795 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912199    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 14 09:43:02.916795 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912203    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 14 09:43:02.916795 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912206    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 14 09:43:02.916795 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912209    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 14 09:43:02.916795 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912212    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 14 09:43:02.916795 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912220    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 14 09:43:02.916795 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912223    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 14 09:43:02.916795 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912225    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 14 09:43:02.916795 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912228    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 14 09:43:02.916795 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912230    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 14 09:43:02.916795 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912233    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 14 09:43:02.916795 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912236    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 14 09:43:02.916795 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912238    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 14 09:43:02.916795 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912241    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 14 09:43:02.916795 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912243    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 14 09:43:02.916795 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912245    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 14 09:43:02.916795 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912249    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 14 09:43:02.916795 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912252    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 14 09:43:02.916795 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912254    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 14 09:43:02.917294 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912257    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 14 09:43:02.917294 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912260    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 14 09:43:02.917294 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912264    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 14 09:43:02.917294 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912267    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 14 09:43:02.917294 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912270    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 14 09:43:02.917294 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912274    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 14 09:43:02.917294 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:02.912277    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 14 09:43:02.917294 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.912283    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 14 09:43:02.917294 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.912410    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 14 09:43:02.917294 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.915023    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 14 09:43:02.917294 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.916064    2581 server.go:1019] "Starting client certificate rotation"
Sep 14 09:43:02.917294 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.916171    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 14 09:43:02.917294 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.916202    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 14 09:43:02.919884 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.919871    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 14 09:43:02.921148 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.921129    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 14 09:43:02.936488 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.936465    2581 log.go:25] "Validated CRI v1 runtime API"
Sep 14 09:43:02.939631 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.939614    2581 log.go:25] "Validated CRI v1 image API"
Sep 14 09:43:02.940555 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.940540    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 14 09:43:02.945566 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.945540    2581 fs.go:135] Filesystem UUIDs: map[59e64f98-1d1e-4133-a4d2-d32bc960703f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a856b748-7e5c-4ac3-bd5f-8937102969fb:/dev/nvme0n1p4]
Sep 14 09:43:02.945647 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.945562    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 14 09:43:02.948604 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.948578    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 14 09:43:02.950218 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.950109    2581 manager.go:216] Machine: {Timestamp:2026-09-14 09:43:02.949588081 +0000 UTC m=+0.380560593 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098376 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2268fc7995f9c75763d29604a650db SystemUUID:ec2268fc-7995-f9c7-5763-d29604a650db BootID:1f4a3282-7611-476a-ade5-ec26b18a35cd Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:de:da:6e:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:de:da:6e:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:9a:cb:d2:76:43 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 14 09:43:02.950218 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.950215    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 14 09:43:02.950341 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.950306    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 14 09:43:02.952468 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.952443    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 14 09:43:02.952631 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.952470    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-247.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 14 09:43:02.953940 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.953929    2581 topology_manager.go:138] "Creating topology manager with none policy"
Sep 14 09:43:02.953990 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.953943    2581 container_manager_linux.go:309] "Creating device plugin manager"
Sep 14 09:43:02.953990 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.953951    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 14 09:43:02.954726 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.954715    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 14 09:43:02.955868 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.955858    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 14 09:43:02.960013 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.959990    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 14 09:43:02.960142 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.960132    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 14 09:43:02.960186 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.960163    2581 kubelet.go:486] "Attempting to sync node with API server"
Sep 14 09:43:02.960186 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.960171    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 14 09:43:02.960186 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.960186    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 14 09:43:02.960296 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.960196    2581 kubelet.go:398] "Adding apiserver pod source"
Sep 14 09:43:02.960296 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.960207    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 14 09:43:02.960756 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.960731    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 14 09:43:02.960854 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.960771    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 14 09:43:02.964338 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.964313    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 14 09:43:02.967227 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.967213    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 14 09:43:02.967288 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.967244    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 14 09:43:02.969278 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.969262    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 14 09:43:02.969278 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.969280    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 14 09:43:02.969371 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.969287    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 14 09:43:02.969371 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.969293    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 14 09:43:02.969371 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.969306    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 14 09:43:02.969371 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.969316    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 14 09:43:02.969371 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.969330    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 14 09:43:02.969371 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.969336    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 14 09:43:02.969371 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.969343    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 14 09:43:02.969371 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.969349    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 14 09:43:02.969371 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.969357    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 14 09:43:02.969371 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.969363    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 14 09:43:02.970224 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.970212    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 14 09:43:02.970224 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.970224    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 14 09:43:02.971096 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:02.971071    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-247.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 14 09:43:02.971158 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:02.971105    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 14 09:43:02.973519 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.973501    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-247.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 14 09:43:02.974099 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.974084    2581 server.go:1268] "Started kubelet"
Sep 14 09:43:02.974244 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.974183    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 14 09:43:02.974296 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.974268    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 14 09:43:02.974896 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.974868    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 14 09:43:02.975181 ip-10-0-132-247 systemd[1]: Started Kubernetes Kubelet.
Sep 14 09:43:02.975842 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.975824    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 14 09:43:02.976951 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.976939    2581 server.go:310] "Adding debug handlers to kubelet server"
Sep 14 09:43:02.979347 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:02.979315    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 14 09:43:02.984263 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.984246    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 14 09:43:02.984342 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.984263    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 14 09:43:02.984342 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:02.984332    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-247.ec2.internal\" not found"
Sep 14 09:43:02.985108 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.984961    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 14 09:43:02.985108 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.985067    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 14 09:43:02.985108 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.985081    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 14 09:43:02.985288 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.985148    2581 factory.go:55] Registering systemd factory
Sep 14 09:43:02.985288 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.985172    2581 reconstruct.go:97] "Volume reconstruction finished"
Sep 14 09:43:02.985288 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.985181    2581 reconciler.go:29] "Reconciler: start to sync state"
Sep 14 09:43:02.985288 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.985184    2581 factory.go:223] Registration of the systemd container factory successfully
Sep 14 09:43:02.985470 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.985373    2581 factory.go:153] Registering CRI-O factory
Sep 14 09:43:02.985470 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.985384    2581 factory.go:223] Registration of the crio container factory successfully
Sep 14 09:43:02.985470 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.985428    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 14 09:43:02.985470 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.985450    2581 factory.go:103] Registering Raw factory
Sep 14 09:43:02.985470 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.985464    2581 manager.go:1196] Started watching for new ooms in manager
Sep 14 09:43:02.985832 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.985819    2581 manager.go:349] Starting recovery of all containers
Sep 14 09:43:02.989532 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:02.989498    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 14 09:43:02.989686 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:02.989646    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-247.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 14 09:43:02.990796 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:02.989628    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-247.ec2.internal.18d526b458b7ef51  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-247.ec2.internal,UID:ip-10-0-132-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-247.ec2.internal,},FirstTimestamp:2026-09-14 09:43:02.974058321 +0000 UTC m=+0.405030833,LastTimestamp:2026-09-14 09:43:02.974058321 +0000 UTC m=+0.405030833,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-247.ec2.internal,}"
Sep 14 09:43:02.997601 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:02.997584    2581 manager.go:354] Recovery completed
Sep 14 09:43:03.002274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.002259    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 09:43:03.004142 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.004125    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 09:43:03.004221 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.004160    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 09:43:03.004221 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.004176    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeHasSufficientPID"
Sep 14 09:43:03.004826 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.004812    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 14 09:43:03.004826 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.004824    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 14 09:43:03.004906 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.004842    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 14 09:43:03.004906 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.004840    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 09:43:03.005572 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.005548    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 09:43:03.005660 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.005591    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 09:43:03.005660 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.005608    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeHasSufficientPID"
Sep 14 09:43:03.008412 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:03.006747    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-247.ec2.internal.18d526b45a82fb25  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-247.ec2.internal,UID:ip-10-0-132-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-247.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-247.ec2.internal,},FirstTimestamp:2026-09-14 09:43:03.004142373 +0000 UTC m=+0.435114888,LastTimestamp:2026-09-14 09:43:03.004142373 +0000 UTC m=+0.435114888,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-247.ec2.internal,}"
Sep 14 09:43:03.008412 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.007095    2581 policy_none.go:49] "None policy: Start"
Sep 14 09:43:03.008412 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.007220    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 14 09:43:03.008412 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.007232    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 14 09:43:03.009153 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.009138    2581 policy_none.go:47] "Start"
Sep 14 09:43:03.016006 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:03.015925    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-247.ec2.internal.18d526b45a835cf8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-247.ec2.internal,UID:ip-10-0-132-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-247.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-247.ec2.internal,},FirstTimestamp:2026-09-14 09:43:03.004167416 +0000 UTC m=+0.435139929,LastTimestamp:2026-09-14 09:43:03.004167416 +0000 UTC m=+0.435139929,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-247.ec2.internal,}"
Sep 14 09:43:03.033650 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.033622    2581 manager.go:337] "Starting Device Plugin manager"
Sep 14 09:43:03.033796 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:03.033686    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 14 09:43:03.033796 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.033700    2581 server.go:87] "Starting device plugin registration server"
Sep 14 09:43:03.033796 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:03.033707    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-247.ec2.internal.18d526b45a83946a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-247.ec2.internal,UID:ip-10-0-132-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-247.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-247.ec2.internal,},FirstTimestamp:2026-09-14 09:43:03.00418161 +0000 UTC m=+0.435154123,LastTimestamp:2026-09-14 09:43:03.00418161 +0000 UTC m=+0.435154123,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-247.ec2.internal,}"
Sep 14 09:43:03.034175 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.034085    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 14 09:43:03.034175 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.034109    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 14 09:43:03.034398 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.034348    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 14 09:43:03.034457 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.034421    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 14 09:43:03.034457 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.034430    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 14 09:43:03.035268 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:03.035246    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 14 09:43:03.035732 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:03.035703    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-247.ec2.internal\" not found"
Sep 14 09:43:03.061893 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:03.061796    2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-247.ec2.internal.18d526b45a82fb25\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-247.ec2.internal.18d526b45a82fb25  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-247.ec2.internal,UID:ip-10-0-132-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-247.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-247.ec2.internal,},FirstTimestamp:2026-09-14 09:43:03.004142373 +0000 UTC m=+0.435114888,LastTimestamp:2026-09-14 09:43:03.005565407 +0000 UTC m=+0.436537924,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-247.ec2.internal,}"
Sep 14 09:43:03.074976 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.074933    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 14 09:43:03.076108 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.076089    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-78mpc"
Sep 14 09:43:03.076217 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.076200    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 14 09:43:03.076281 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.076258    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 14 09:43:03.076326 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.076288    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 14 09:43:03.076420 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:03.076399    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 14 09:43:03.082869 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:03.082842    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Sep 14 09:43:03.083034 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:03.082868    2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-247.ec2.internal.18d526b45a835cf8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-247.ec2.internal.18d526b45a835cf8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-247.ec2.internal,UID:ip-10-0-132-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-132-247.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-132-247.ec2.internal,},FirstTimestamp:2026-09-14 09:43:03.004167416 +0000 UTC m=+0.435139929,LastTimestamp:2026-09-14 09:43:03.005600067 +0000 UTC m=+0.436572579,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-247.ec2.internal,}"
Sep 14 09:43:03.087615 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:03.087533    2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-132-247.ec2.internal.18d526b45a83946a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-247.ec2.internal.18d526b45a83946a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-247.ec2.internal,UID:ip-10-0-132-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-132-247.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-132-247.ec2.internal,},FirstTimestamp:2026-09-14 09:43:03.00418161 +0000 UTC m=+0.435154123,LastTimestamp:2026-09-14 09:43:03.005611858 +0000 UTC m=+0.436584370,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-247.ec2.internal,}"
Sep 14 09:43:03.088632 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.088613    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-78mpc"
Sep 14 09:43:03.094242 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:03.094179    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-247.ec2.internal.18d526b45c7251b6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-247.ec2.internal,UID:ip-10-0-132-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-132-247.ec2.internal,},FirstTimestamp:2026-09-14 09:43:03.036604854 +0000 UTC m=+0.467577369,LastTimestamp:2026-09-14 09:43:03.036604854 +0000 UTC m=+0.467577369,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-247.ec2.internal,}"
Sep 14 09:43:03.134422 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.134393    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 09:43:03.135521 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.135507    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 09:43:03.135598 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.135535    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 09:43:03.135598 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.135545    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeHasSufficientPID"
Sep 14 09:43:03.135598 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.135570    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-247.ec2.internal"
Sep 14 09:43:03.143420 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.143347    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-247.ec2.internal"
Sep 14 09:43:03.143420 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:03.143374    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-247.ec2.internal\": node \"ip-10-0-132-247.ec2.internal\" not found"
Sep 14 09:43:03.171854 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:03.171829    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-247.ec2.internal\" not found"
Sep 14 09:43:03.176906 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.176883    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-247.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-247.ec2.internal"]
Sep 14 09:43:03.177022 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.176982    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 09:43:03.178479 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.178463    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 09:43:03.178577 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.178491    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 09:43:03.178577 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.178501    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeHasSufficientPID"
Sep 14 09:43:03.180589 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.180577    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 09:43:03.180703 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.180687    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-247.ec2.internal"
Sep 14 09:43:03.180745 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.180720    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 09:43:03.182579 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.182517    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 09:43:03.182579 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.182553    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 09:43:03.182579 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.182579    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 09:43:03.182792 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.182593    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeHasSufficientPID"
Sep 14 09:43:03.182792 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.182555    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 09:43:03.182792 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.182639    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeHasSufficientPID"
Sep 14 09:43:03.186795 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.186775    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-247.ec2.internal"
Sep 14 09:43:03.186869 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.186820    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 14 09:43:03.187628 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.187608    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeHasSufficientMemory"
Sep 14 09:43:03.187721 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.187643    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeHasNoDiskPressure"
Sep 14 09:43:03.187721 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.187659    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeHasSufficientPID"
Sep 14 09:43:03.196588 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:03.196568    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-247.ec2.internal\" not found" node="ip-10-0-132-247.ec2.internal"
Sep 14 09:43:03.201951 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:03.201937    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-247.ec2.internal\" not found" node="ip-10-0-132-247.ec2.internal"
Sep 14 09:43:03.272222 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:03.272175    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-247.ec2.internal\" not found"
Sep 14 09:43:03.286651 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.286626    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f6a8db1d929676593bd9a89c05273daf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-247.ec2.internal\" (UID: \"f6a8db1d929676593bd9a89c05273daf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-247.ec2.internal"
Sep 14 09:43:03.286717 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.286660    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6a8db1d929676593bd9a89c05273daf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-247.ec2.internal\" (UID: \"f6a8db1d929676593bd9a89c05273daf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-247.ec2.internal"
Sep 14 09:43:03.286717 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.286679    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4c9742fcc68c982c9ec23fd7b6742875-config\") pod \"kube-apiserver-proxy-ip-10-0-132-247.ec2.internal\" (UID: \"4c9742fcc68c982c9ec23fd7b6742875\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-247.ec2.internal"
Sep 14 09:43:03.372317 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:03.372290    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-247.ec2.internal\" not found"
Sep 14 09:43:03.387602 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.387570    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f6a8db1d929676593bd9a89c05273daf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-247.ec2.internal\" (UID: \"f6a8db1d929676593bd9a89c05273daf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-247.ec2.internal"
Sep 14 09:43:03.387724 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.387616    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6a8db1d929676593bd9a89c05273daf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-247.ec2.internal\" (UID: \"f6a8db1d929676593bd9a89c05273daf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-247.ec2.internal"
Sep 14 09:43:03.387724 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.387632    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f6a8db1d929676593bd9a89c05273daf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-247.ec2.internal\" (UID: \"f6a8db1d929676593bd9a89c05273daf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-247.ec2.internal"
Sep 14 09:43:03.387724 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.387673    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6a8db1d929676593bd9a89c05273daf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-247.ec2.internal\" (UID: \"f6a8db1d929676593bd9a89c05273daf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-247.ec2.internal"
Sep 14 09:43:03.387724 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.387696    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4c9742fcc68c982c9ec23fd7b6742875-config\") pod \"kube-apiserver-proxy-ip-10-0-132-247.ec2.internal\" (UID: \"4c9742fcc68c982c9ec23fd7b6742875\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-247.ec2.internal"
Sep 14 09:43:03.387839 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:03.387730    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4c9742fcc68c982c9ec23fd7b6742875-config\") pod \"kube-apiserver-proxy-ip-10-0-132-247.ec2.internal\" (UID: \"4c9742fcc68c982c9ec23fd7b6742875\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-247.ec2.internal"
Sep 14 09:43:03.473071 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:03.473009    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-247.ec2.internal\" not found"
Sep 14 09:43:05.072167 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.072144    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-247.ec2.internal"
Sep 14 09:43:05.077351 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.077259    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-247.ec2.internal"
Sep 14 09:43:05.146819 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:05.146782    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-247.ec2.internal\" not found"
Sep 14 09:43:05.247271 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:05.247236    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-247.ec2.internal\" not found"
Sep 14 09:43:05.347914 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:05.347824    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-247.ec2.internal\" not found"
Sep 14 09:43:05.448374 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:05.448340    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-247.ec2.internal\" not found"
Sep 14 09:43:05.488870 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.488846    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 14 09:43:05.513379 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.513348    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 09:43:05.534080 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.534053    2581 apiserver.go:52] "Watching apiserver"
Sep 14 09:43:05.540382 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.540361    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 09:43:05.545929 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.544762    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 14 09:43:05.545929 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.545519    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-pnznq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg","openshift-cluster-node-tuning-operator/tuned-grhmb","openshift-multus/multus-bq5mf","openshift-multus/network-metrics-daemon-wlcmj","openshift-network-operator/iptables-alerter-bsbms","openshift-dns/node-resolver-k4h57","openshift-image-registry/node-ca-c2bz4","openshift-multus/multus-additional-cni-plugins-8xhxq","openshift-network-diagnostics/network-check-target-rfwwn","openshift-ovn-kubernetes/ovnkube-node-qmq8t","kube-system/global-pull-secret-syncer-4rsn7"]
Sep 14 09:43:05.548010 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.547989    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pnznq"
Sep 14 09:43:05.550241 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.550218    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.551412 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.551396    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 14 09:43:05.551473 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.551443    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lrgk4\""
Sep 14 09:43:05.551583 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.551569    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 14 09:43:05.552925 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.552907    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.553118 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.553103    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 14 09:43:05.553208 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.553117    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9jhfc\""
Sep 14 09:43:05.553354 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.553339    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 14 09:43:05.554175 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.554160    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 14 09:43:05.555145 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.555129    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.555575 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.555558    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 14 09:43:05.556448 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.556432    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 14 09:43:05.556729 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.556700    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-585bf\""
Sep 14 09:43:05.557379 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.557366    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-247.ec2.internal"
Sep 14 09:43:05.557456 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.557435    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 14 09:43:05.557575 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.557460    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:05.557575 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:05.557543    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlcmj" podUID="930e6273-c402-447a-ade0-f00b6248df0d"
Sep 14 09:43:05.557660 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.557637    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 14 09:43:05.558382 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.558367    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 14 09:43:05.558480 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.558465    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 14 09:43:05.558653 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.558622    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 14 09:43:05.558751 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.558695    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8zf54\""
Sep 14 09:43:05.559801 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.559780    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bsbms"
Sep 14 09:43:05.562380 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.562355    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k4h57"
Sep 14 09:43:05.562823 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.562805    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-sys\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.562913 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.562829    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-lib-modules\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.562913 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.562844    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-hostroot\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.562913 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.562858    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-host-run-multus-certs\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.562913 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.562874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e4bd39b-b3ae-4b10-ad3a-67c87e399fed-agent-certs\") pod \"konnectivity-agent-pnznq\" (UID: \"7e4bd39b-b3ae-4b10-ad3a-67c87e399fed\") " pod="kube-system/konnectivity-agent-pnznq"
Sep 14 09:43:05.563106 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.562920    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-etc-kubernetes\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.563106 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.562945    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-var-lib-kubelet\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.563106 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.562986    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5da0c88c-eed9-4a80-aa60-df7da11033cc-etc-tuned\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.563106 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563009    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-cnibin\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.563106 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563026    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs\") pod \"network-metrics-daemon-wlcmj\" (UID: \"930e6273-c402-447a-ade0-f00b6248df0d\") " pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:05.563106 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcsm4\" (UniqueName: \"kubernetes.io/projected/5da0c88c-eed9-4a80-aa60-df7da11033cc-kube-api-access-xcsm4\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.563106 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563075    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-multus-socket-dir-parent\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.563106 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563090    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-host-var-lib-cni-bin\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.563479 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563124    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-host-var-lib-cni-multus\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.563479 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563148    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-multus-conf-dir\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.563479 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563164    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ba40a4a-c919-4386-97eb-392cad6cf6d1-iptables-alerter-script\") pod \"iptables-alerter-bsbms\" (UID: \"4ba40a4a-c919-4386-97eb-392cad6cf6d1\") " pod="openshift-network-operator/iptables-alerter-bsbms"
Sep 14 09:43:05.563479 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563179    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlgk4\" (UniqueName: \"kubernetes.io/projected/4ba40a4a-c919-4386-97eb-392cad6cf6d1-kube-api-access-rlgk4\") pod \"iptables-alerter-bsbms\" (UID: \"4ba40a4a-c919-4386-97eb-392cad6cf6d1\") " pod="openshift-network-operator/iptables-alerter-bsbms"
Sep 14 09:43:05.563479 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563193    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e46b7233-8686-456c-9d0b-fad99d708742-etc-selinux\") pod \"aws-ebs-csi-driver-node-bnwtg\" (UID: \"e46b7233-8686-456c-9d0b-fad99d708742\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.563479 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563223    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-etc-sysconfig\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.563479 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563264    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-host\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.563479 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563289    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-system-cni-dir\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.563479 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563313    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-multus-cni-dir\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.563479 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563328    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e46b7233-8686-456c-9d0b-fad99d708742-device-dir\") pod \"aws-ebs-csi-driver-node-bnwtg\" (UID: \"e46b7233-8686-456c-9d0b-fad99d708742\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.563479 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563364    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e46b7233-8686-456c-9d0b-fad99d708742-sys-fs\") pod \"aws-ebs-csi-driver-node-bnwtg\" (UID: \"e46b7233-8686-456c-9d0b-fad99d708742\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.563479 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563383    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-etc-systemd\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.563479 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563400    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-host-var-lib-kubelet\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.563479 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563422    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdb5w\" (UniqueName: \"kubernetes.io/projected/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-kube-api-access-tdb5w\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.563479 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563444    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtkmf\" (UniqueName: \"kubernetes.io/projected/930e6273-c402-447a-ade0-f00b6248df0d-kube-api-access-xtkmf\") pod \"network-metrics-daemon-wlcmj\" (UID: \"930e6273-c402-447a-ade0-f00b6248df0d\") " pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:05.563479 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563459    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e4bd39b-b3ae-4b10-ad3a-67c87e399fed-konnectivity-ca\") pod \"konnectivity-agent-pnznq\" (UID: \"7e4bd39b-b3ae-4b10-ad3a-67c87e399fed\") " pod="kube-system/konnectivity-agent-pnznq"
Sep 14 09:43:05.564247 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e46b7233-8686-456c-9d0b-fad99d708742-registration-dir\") pod \"aws-ebs-csi-driver-node-bnwtg\" (UID: \"e46b7233-8686-456c-9d0b-fad99d708742\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.564247 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563489    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-etc-sysctl-d\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.564247 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563510    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-run\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.564247 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563533    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5da0c88c-eed9-4a80-aa60-df7da11033cc-tmp\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.564247 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563549    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-multus-daemon-config\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.564247 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563563    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjlcv\" (UniqueName: \"kubernetes.io/projected/e46b7233-8686-456c-9d0b-fad99d708742-kube-api-access-bjlcv\") pod \"aws-ebs-csi-driver-node-bnwtg\" (UID: \"e46b7233-8686-456c-9d0b-fad99d708742\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.564247 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563577    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-cni-binary-copy\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.564247 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563598    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-etc-kubernetes\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.564247 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563625    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ba40a4a-c919-4386-97eb-392cad6cf6d1-host-slash\") pod \"iptables-alerter-bsbms\" (UID: \"4ba40a4a-c919-4386-97eb-392cad6cf6d1\") " pod="openshift-network-operator/iptables-alerter-bsbms"
Sep 14 09:43:05.564247 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563653    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e46b7233-8686-456c-9d0b-fad99d708742-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bnwtg\" (UID: \"e46b7233-8686-456c-9d0b-fad99d708742\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.564247 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563675    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-etc-modprobe-d\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.564247 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563692    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-etc-sysctl-conf\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.564247 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563724    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-host-run-k8s-cni-cncf-io\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.564247 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563757    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-host-run-netns\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.564247 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.563771    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e46b7233-8686-456c-9d0b-fad99d708742-socket-dir\") pod \"aws-ebs-csi-driver-node-bnwtg\" (UID: \"e46b7233-8686-456c-9d0b-fad99d708742\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.564971 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.564533    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 14 09:43:05.564971 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.564607    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 14 09:43:05.564971 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.564758    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 14 09:43:05.564971 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.564870    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nfpxs\""
Sep 14 09:43:05.565166 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.565011    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bndtx\""
Sep 14 09:43:05.565233 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.565217    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c2bz4"
Sep 14 09:43:05.565400 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.565329    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 14 09:43:05.566763 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.566744    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 14 09:43:05.568027 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.568011    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.568965 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.568948    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wh4fc\""
Sep 14 09:43:05.569398 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.569384    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 14 09:43:05.570132 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.570115    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 14 09:43:05.570316 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.570303    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 14 09:43:05.570819 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.570787    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:05.570909 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:05.570868    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfwwn" podUID="988fb8db-aad4-41fb-b072-6441acaf7135"
Sep 14 09:43:05.570971 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.570948    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 14 09:43:05.571228 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.571209    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 14 09:43:05.572816 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.572800    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4whkh\""
Sep 14 09:43:05.573462 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.573447    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.575938 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.575918    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:05.576034 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:05.575973    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rsn7" podUID="684f63fb-ee2f-41ac-a26b-759fa9c2d043"
Sep 14 09:43:05.576101 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.576051    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 14 09:43:05.576177 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.576163    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 14 09:43:05.576250 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.576235    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 14 09:43:05.576399 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.576385    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 14 09:43:05.576443 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.576414    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 14 09:43:05.576878 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.576865    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mgvd9\""
Sep 14 09:43:05.577273 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.577255    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 14 09:43:05.591472 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.591440    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 14 09:43:05.591615 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.591543    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-247.ec2.internal"
Sep 14 09:43:05.591615 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.591561    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-247.ec2.internal"]
Sep 14 09:43:05.596145 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.596126    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 14 09:43:05.604911 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.604866    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-247.ec2.internal"]
Sep 14 09:43:05.606103 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.606088    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 14 09:43:05.629737 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.629698    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-76wds"
Sep 14 09:43:05.646145 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.646121    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-76wds"
Sep 14 09:43:05.659469 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.659447    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 14 09:43:05.663973 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.663946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-var-lib-kubelet\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.664098 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.663980    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs\") pod \"network-metrics-daemon-wlcmj\" (UID: \"930e6273-c402-447a-ade0-f00b6248df0d\") " pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:05.664098 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664007    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66a14d90-706e-47be-b9bb-2adeb65103bf-host\") pod \"node-ca-c2bz4\" (UID: \"66a14d90-706e-47be-b9bb-2adeb65103bf\") " pod="openshift-image-registry/node-ca-c2bz4"
Sep 14 09:43:05.664098 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664032    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/016118b7-1766-41e1-9d3a-2ae2cc9c187c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8xhxq\" (UID: \"016118b7-1766-41e1-9d3a-2ae2cc9c187c\") " pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.664098 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664052    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-var-lib-kubelet\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.664098 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664057    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af3b9fa5-b5eb-41b5-b21f-c3983847fb50-tmp-dir\") pod \"node-resolver-k4h57\" (UID: \"af3b9fa5-b5eb-41b5-b21f-c3983847fb50\") " pod="openshift-dns/node-resolver-k4h57"
Sep 14 09:43:05.664278 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:05.664101    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 09:43:05.664278 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664112    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-host-var-lib-cni-bin\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.664278 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-host-var-lib-cni-multus\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.664278 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:05.664181    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs podName:930e6273-c402-447a-ade0-f00b6248df0d nodeName:}" failed. No retries permitted until 2026-09-14 09:43:06.164160071 +0000 UTC m=+2.022392429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs") pod "network-metrics-daemon-wlcmj" (UID: "930e6273-c402-447a-ade0-f00b6248df0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 09:43:05.664278 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664206    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-host-var-lib-cni-multus\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.664278 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664247    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-multus-conf-dir\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.664278 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664260    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-host-var-lib-cni-bin\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.664278 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664268    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e46b7233-8686-456c-9d0b-fad99d708742-etc-selinux\") pod \"aws-ebs-csi-driver-node-bnwtg\" (UID: \"e46b7233-8686-456c-9d0b-fad99d708742\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.664615 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664285    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-host-slash\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.664615 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664300    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-multus-conf-dir\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.664615 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664303    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.664615 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664338    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-etc-sysconfig\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.664615 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664363    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e46b7233-8686-456c-9d0b-fad99d708742-device-dir\") pod \"aws-ebs-csi-driver-node-bnwtg\" (UID: \"e46b7233-8686-456c-9d0b-fad99d708742\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.664615 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664387    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-etc-systemd\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.664615 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664410    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-host-var-lib-kubelet\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.664615 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664413    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-etc-sysconfig\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.664615 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664409    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e46b7233-8686-456c-9d0b-fad99d708742-etc-selinux\") pod \"aws-ebs-csi-driver-node-bnwtg\" (UID: \"e46b7233-8686-456c-9d0b-fad99d708742\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.664615 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664434    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-etc-openvswitch\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.664615 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664444    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-etc-systemd\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.664615 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664460    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e46b7233-8686-456c-9d0b-fad99d708742-device-dir\") pod \"aws-ebs-csi-driver-node-bnwtg\" (UID: \"e46b7233-8686-456c-9d0b-fad99d708742\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.664615 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664463    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-host-var-lib-kubelet\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.664615 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-etc-sysctl-d\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.664615 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664513    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5da0c88c-eed9-4a80-aa60-df7da11033cc-tmp\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.664615 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664529    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-multus-daemon-config\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.664615 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664545    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjlcv\" (UniqueName: \"kubernetes.io/projected/e46b7233-8686-456c-9d0b-fad99d708742-kube-api-access-bjlcv\") pod \"aws-ebs-csi-driver-node-bnwtg\" (UID: \"e46b7233-8686-456c-9d0b-fad99d708742\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.665418 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664554    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-etc-sysctl-d\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.665418 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664567    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/016118b7-1766-41e1-9d3a-2ae2cc9c187c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8xhxq\" (UID: \"016118b7-1766-41e1-9d3a-2ae2cc9c187c\") " pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.665418 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664586    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-host-kubelet\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.665418 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664610    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59mwj\" (UniqueName: \"kubernetes.io/projected/66a14d90-706e-47be-b9bb-2adeb65103bf-kube-api-access-59mwj\") pod \"node-ca-c2bz4\" (UID: \"66a14d90-706e-47be-b9bb-2adeb65103bf\") " pod="openshift-image-registry/node-ca-c2bz4"
Sep 14 09:43:05.665418 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664638    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/016118b7-1766-41e1-9d3a-2ae2cc9c187c-system-cni-dir\") pod \"multus-additional-cni-plugins-8xhxq\" (UID: \"016118b7-1766-41e1-9d3a-2ae2cc9c187c\") " pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.665418 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664665    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-etc-sysctl-conf\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.665418 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664726    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e46b7233-8686-456c-9d0b-fad99d708742-socket-dir\") pod \"aws-ebs-csi-driver-node-bnwtg\" (UID: \"e46b7233-8686-456c-9d0b-fad99d708742\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.665418 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664766    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-host-run-netns\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.665418 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664812    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-etc-sysctl-conf\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.665418 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664829    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-run-openvswitch\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.665418 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664868    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e46b7233-8686-456c-9d0b-fad99d708742-socket-dir\") pod \"aws-ebs-csi-driver-node-bnwtg\" (UID: \"e46b7233-8686-456c-9d0b-fad99d708742\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.665418 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664875    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-sys\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.665418 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664902    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 14 09:43:05.665418 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664945    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-sys\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.665418 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664941    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-hostroot\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.665418 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664905    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-hostroot\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.665418 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.664983    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/684f63fb-ee2f-41ac-a26b-759fa9c2d043-dbus\") pod \"global-pull-secret-syncer-4rsn7\" (UID: \"684f63fb-ee2f-41ac-a26b-759fa9c2d043\") " pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:05.666238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665000    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59clw\" (UniqueName: \"kubernetes.io/projected/016118b7-1766-41e1-9d3a-2ae2cc9c187c-kube-api-access-59clw\") pod \"multus-additional-cni-plugins-8xhxq\" (UID: \"016118b7-1766-41e1-9d3a-2ae2cc9c187c\") " pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.666238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665016    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5da0c88c-eed9-4a80-aa60-df7da11033cc-etc-tuned\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.666238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665039    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-cnibin\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.666238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/00d21667-eb67-4fd8-bdaa-7f2935e6e131-env-overrides\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.666238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665072    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-multus-daemon-config\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.666238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665084    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/00d21667-eb67-4fd8-bdaa-7f2935e6e131-ovn-node-metrics-cert\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.666238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665110    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-cnibin\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.666238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665122    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnk8h\" (UniqueName: \"kubernetes.io/projected/00d21667-eb67-4fd8-bdaa-7f2935e6e131-kube-api-access-tnk8h\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.666238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665166    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af3b9fa5-b5eb-41b5-b21f-c3983847fb50-hosts-file\") pod \"node-resolver-k4h57\" (UID: \"af3b9fa5-b5eb-41b5-b21f-c3983847fb50\") " pod="openshift-dns/node-resolver-k4h57"
Sep 14 09:43:05.666238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665189    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcsm4\" (UniqueName: \"kubernetes.io/projected/5da0c88c-eed9-4a80-aa60-df7da11033cc-kube-api-access-xcsm4\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.666238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665167    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-13 09:38:04 +0000 UTC" deadline="2028-05-25 07:11:51.8112188 +0000 UTC"
Sep 14 09:43:05.666238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665207    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14853h28m46.146015072s"
Sep 14 09:43:05.666238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-multus-socket-dir-parent\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.666238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ba40a4a-c919-4386-97eb-392cad6cf6d1-iptables-alerter-script\") pod \"iptables-alerter-bsbms\" (UID: \"4ba40a4a-c919-4386-97eb-392cad6cf6d1\") " pod="openshift-network-operator/iptables-alerter-bsbms"
Sep 14 09:43:05.666238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665247    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlgk4\" (UniqueName: \"kubernetes.io/projected/4ba40a4a-c919-4386-97eb-392cad6cf6d1-kube-api-access-rlgk4\") pod \"iptables-alerter-bsbms\" (UID: \"4ba40a4a-c919-4386-97eb-392cad6cf6d1\") " pod="openshift-network-operator/iptables-alerter-bsbms"
Sep 14 09:43:05.666238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665283    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-multus-socket-dir-parent\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.666238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665309    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/66a14d90-706e-47be-b9bb-2adeb65103bf-serviceca\") pod \"node-ca-c2bz4\" (UID: \"66a14d90-706e-47be-b9bb-2adeb65103bf\") " pod="openshift-image-registry/node-ca-c2bz4"
Sep 14 09:43:05.666238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665327    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret\") pod \"global-pull-secret-syncer-4rsn7\" (UID: \"684f63fb-ee2f-41ac-a26b-759fa9c2d043\") " pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:05.666902 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665346    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9864x\" (UniqueName: \"kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x\") pod \"network-check-target-rfwwn\" (UID: \"988fb8db-aad4-41fb-b072-6441acaf7135\") " pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:05.666902 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665373    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-host\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.666902 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665413    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-host\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.666902 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665419    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-system-cni-dir\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.666902 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665447    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-multus-cni-dir\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.666902 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665483    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e46b7233-8686-456c-9d0b-fad99d708742-sys-fs\") pod \"aws-ebs-csi-driver-node-bnwtg\" (UID: \"e46b7233-8686-456c-9d0b-fad99d708742\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.666902 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665509    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gg7g\" (UniqueName: \"kubernetes.io/projected/af3b9fa5-b5eb-41b5-b21f-c3983847fb50-kube-api-access-6gg7g\") pod \"node-resolver-k4h57\" (UID: \"af3b9fa5-b5eb-41b5-b21f-c3983847fb50\") " pod="openshift-dns/node-resolver-k4h57"
Sep 14 09:43:05.666902 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665534    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/016118b7-1766-41e1-9d3a-2ae2cc9c187c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8xhxq\" (UID: \"016118b7-1766-41e1-9d3a-2ae2cc9c187c\") " pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.666902 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665538    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e46b7233-8686-456c-9d0b-fad99d708742-sys-fs\") pod \"aws-ebs-csi-driver-node-bnwtg\" (UID: \"e46b7233-8686-456c-9d0b-fad99d708742\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.666902 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665542    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-system-cni-dir\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.666902 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665553    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-var-lib-openvswitch\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.666902 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665583    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-run-ovn\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.666902 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665603    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdb5w\" (UniqueName: \"kubernetes.io/projected/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-kube-api-access-tdb5w\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.666902 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665620    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtkmf\" (UniqueName: \"kubernetes.io/projected/930e6273-c402-447a-ade0-f00b6248df0d-kube-api-access-xtkmf\") pod \"network-metrics-daemon-wlcmj\" (UID: \"930e6273-c402-447a-ade0-f00b6248df0d\") " pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:05.666902 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665642    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e4bd39b-b3ae-4b10-ad3a-67c87e399fed-konnectivity-ca\") pod \"konnectivity-agent-pnznq\" (UID: \"7e4bd39b-b3ae-4b10-ad3a-67c87e399fed\") " pod="kube-system/konnectivity-agent-pnznq"
Sep 14 09:43:05.666902 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665666    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e46b7233-8686-456c-9d0b-fad99d708742-registration-dir\") pod \"aws-ebs-csi-driver-node-bnwtg\" (UID: \"e46b7233-8686-456c-9d0b-fad99d708742\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.666902 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665681    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-node-log\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.667539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665695    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-run\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.667539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665726    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-run-systemd\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.667539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665768    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ba40a4a-c919-4386-97eb-392cad6cf6d1-iptables-alerter-script\") pod \"iptables-alerter-bsbms\" (UID: \"4ba40a4a-c919-4386-97eb-392cad6cf6d1\") " pod="openshift-network-operator/iptables-alerter-bsbms"
Sep 14 09:43:05.667539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665777    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-log-socket\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.667539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665602    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-multus-cni-dir\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.667539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665798    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-host-cni-netd\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.667539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665848    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/00d21667-eb67-4fd8-bdaa-7f2935e6e131-ovnkube-script-lib\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.667539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665861    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e46b7233-8686-456c-9d0b-fad99d708742-registration-dir\") pod \"aws-ebs-csi-driver-node-bnwtg\" (UID: \"e46b7233-8686-456c-9d0b-fad99d708742\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.667539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665875    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-cni-binary-copy\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.667539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665899    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-etc-kubernetes\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.667539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665921    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ba40a4a-c919-4386-97eb-392cad6cf6d1-host-slash\") pod \"iptables-alerter-bsbms\" (UID: \"4ba40a4a-c919-4386-97eb-392cad6cf6d1\") " pod="openshift-network-operator/iptables-alerter-bsbms"
Sep 14 09:43:05.667539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665940    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e46b7233-8686-456c-9d0b-fad99d708742-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bnwtg\" (UID: \"e46b7233-8686-456c-9d0b-fad99d708742\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.667539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665948    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-run\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.667539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665965    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/016118b7-1766-41e1-9d3a-2ae2cc9c187c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8xhxq\" (UID: \"016118b7-1766-41e1-9d3a-2ae2cc9c187c\") " pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.667539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665986    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ba40a4a-c919-4386-97eb-392cad6cf6d1-host-slash\") pod \"iptables-alerter-bsbms\" (UID: \"4ba40a4a-c919-4386-97eb-392cad6cf6d1\") " pod="openshift-network-operator/iptables-alerter-bsbms"
Sep 14 09:43:05.667539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.665987    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-host-cni-bin\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.667539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666016    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-etc-modprobe-d\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.668052 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666019    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-etc-kubernetes\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.668052 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666042    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-host-run-k8s-cni-cncf-io\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.668052 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666066    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-host-run-netns\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.668052 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666074    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e46b7233-8686-456c-9d0b-fad99d708742-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bnwtg\" (UID: \"e46b7233-8686-456c-9d0b-fad99d708742\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.668052 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666100    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/684f63fb-ee2f-41ac-a26b-759fa9c2d043-kubelet-config\") pod \"global-pull-secret-syncer-4rsn7\" (UID: \"684f63fb-ee2f-41ac-a26b-759fa9c2d043\") " pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:05.668052 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666129    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/016118b7-1766-41e1-9d3a-2ae2cc9c187c-cnibin\") pod \"multus-additional-cni-plugins-8xhxq\" (UID: \"016118b7-1766-41e1-9d3a-2ae2cc9c187c\") " pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.668052 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666130    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-etc-modprobe-d\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.668052 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666155    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-host-run-k8s-cni-cncf-io\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.668052 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666191    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-systemd-units\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.668052 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666198    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7e4bd39b-b3ae-4b10-ad3a-67c87e399fed-konnectivity-ca\") pod \"konnectivity-agent-pnznq\" (UID: \"7e4bd39b-b3ae-4b10-ad3a-67c87e399fed\") " pod="kube-system/konnectivity-agent-pnznq"
Sep 14 09:43:05.668052 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-lib-modules\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.668052 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-host-run-multus-certs\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.668052 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666283    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-host-run-netns\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.668052 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666284    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e4bd39b-b3ae-4b10-ad3a-67c87e399fed-agent-certs\") pod \"konnectivity-agent-pnznq\" (UID: \"7e4bd39b-b3ae-4b10-ad3a-67c87e399fed\") " pod="kube-system/konnectivity-agent-pnznq"
Sep 14 09:43:05.668052 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666339    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-host-run-multus-certs\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.668052 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666345    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-cni-binary-copy\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.668052 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666362    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-lib-modules\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.668642 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666382    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-host-run-ovn-kubernetes\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.668642 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666418    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/00d21667-eb67-4fd8-bdaa-7f2935e6e131-ovnkube-config\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.668642 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666452    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-etc-kubernetes\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.668642 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.666491    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5da0c88c-eed9-4a80-aa60-df7da11033cc-etc-kubernetes\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.668642 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.668328    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5da0c88c-eed9-4a80-aa60-df7da11033cc-tmp\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.668642 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.668448    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5da0c88c-eed9-4a80-aa60-df7da11033cc-etc-tuned\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.668958 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.668645    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7e4bd39b-b3ae-4b10-ad3a-67c87e399fed-agent-certs\") pod \"konnectivity-agent-pnznq\" (UID: \"7e4bd39b-b3ae-4b10-ad3a-67c87e399fed\") " pod="kube-system/konnectivity-agent-pnznq"
Sep 14 09:43:05.682787 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.682754    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdb5w\" (UniqueName: \"kubernetes.io/projected/c48a8e26-29cb-441e-a59e-cc9ef5edcf1f-kube-api-access-tdb5w\") pod \"multus-bq5mf\" (UID: \"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f\") " pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.682912 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.682807    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlgk4\" (UniqueName: \"kubernetes.io/projected/4ba40a4a-c919-4386-97eb-392cad6cf6d1-kube-api-access-rlgk4\") pod \"iptables-alerter-bsbms\" (UID: \"4ba40a4a-c919-4386-97eb-392cad6cf6d1\") " pod="openshift-network-operator/iptables-alerter-bsbms"
Sep 14 09:43:05.682912 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.682867    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcsm4\" (UniqueName: \"kubernetes.io/projected/5da0c88c-eed9-4a80-aa60-df7da11033cc-kube-api-access-xcsm4\") pod \"tuned-grhmb\" (UID: \"5da0c88c-eed9-4a80-aa60-df7da11033cc\") " pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.683205 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.683187    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjlcv\" (UniqueName: \"kubernetes.io/projected/e46b7233-8686-456c-9d0b-fad99d708742-kube-api-access-bjlcv\") pod \"aws-ebs-csi-driver-node-bnwtg\" (UID: \"e46b7233-8686-456c-9d0b-fad99d708742\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.686259 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.686238    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtkmf\" (UniqueName: \"kubernetes.io/projected/930e6273-c402-447a-ade0-f00b6248df0d-kube-api-access-xtkmf\") pod \"network-metrics-daemon-wlcmj\" (UID: \"930e6273-c402-447a-ade0-f00b6248df0d\") " pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:05.723485 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.723462    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 09:43:05.730258 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:05.730230    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c9742fcc68c982c9ec23fd7b6742875.slice/crio-29ca21cfd7a8b623ccb226760003204222146636cda6da4034b443f01727e150 WatchSource:0}: Error finding container 29ca21cfd7a8b623ccb226760003204222146636cda6da4034b443f01727e150: Status 404 returned error can't find the container with id 29ca21cfd7a8b623ccb226760003204222146636cda6da4034b443f01727e150
Sep 14 09:43:05.735762 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.735743    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 09:43:05.739110 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:05.739089    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a8db1d929676593bd9a89c05273daf.slice/crio-b060244c82733332590742a7523b058bd2d110641349b5f707c43b3fb82721a8 WatchSource:0}: Error finding container b060244c82733332590742a7523b058bd2d110641349b5f707c43b3fb82721a8: Status 404 returned error can't find the container with id b060244c82733332590742a7523b058bd2d110641349b5f707c43b3fb82721a8
Sep 14 09:43:05.766207 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.766181    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 14 09:43:05.767083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767062    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-run-openvswitch\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.767173 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/684f63fb-ee2f-41ac-a26b-759fa9c2d043-dbus\") pod \"global-pull-secret-syncer-4rsn7\" (UID: \"684f63fb-ee2f-41ac-a26b-759fa9c2d043\") " pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:05.767173 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767123    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59clw\" (UniqueName: \"kubernetes.io/projected/016118b7-1766-41e1-9d3a-2ae2cc9c187c-kube-api-access-59clw\") pod \"multus-additional-cni-plugins-8xhxq\" (UID: \"016118b7-1766-41e1-9d3a-2ae2cc9c187c\") " pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.767173 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767148    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/00d21667-eb67-4fd8-bdaa-7f2935e6e131-env-overrides\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.767173 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767165    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-run-openvswitch\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.767363 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767172    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/00d21667-eb67-4fd8-bdaa-7f2935e6e131-ovn-node-metrics-cert\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.767363 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767197    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/684f63fb-ee2f-41ac-a26b-759fa9c2d043-dbus\") pod \"global-pull-secret-syncer-4rsn7\" (UID: \"684f63fb-ee2f-41ac-a26b-759fa9c2d043\") " pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:05.767363 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767201    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnk8h\" (UniqueName: \"kubernetes.io/projected/00d21667-eb67-4fd8-bdaa-7f2935e6e131-kube-api-access-tnk8h\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.767363 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767238    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af3b9fa5-b5eb-41b5-b21f-c3983847fb50-hosts-file\") pod \"node-resolver-k4h57\" (UID: \"af3b9fa5-b5eb-41b5-b21f-c3983847fb50\") " pod="openshift-dns/node-resolver-k4h57"
Sep 14 09:43:05.767363 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767269    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/66a14d90-706e-47be-b9bb-2adeb65103bf-serviceca\") pod \"node-ca-c2bz4\" (UID: \"66a14d90-706e-47be-b9bb-2adeb65103bf\") " pod="openshift-image-registry/node-ca-c2bz4"
Sep 14 09:43:05.767363 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767290    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret\") pod \"global-pull-secret-syncer-4rsn7\" (UID: \"684f63fb-ee2f-41ac-a26b-759fa9c2d043\") " pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:05.767363 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9864x\" (UniqueName: \"kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x\") pod \"network-check-target-rfwwn\" (UID: \"988fb8db-aad4-41fb-b072-6441acaf7135\") " pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:05.767363 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767342    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gg7g\" (UniqueName: \"kubernetes.io/projected/af3b9fa5-b5eb-41b5-b21f-c3983847fb50-kube-api-access-6gg7g\") pod \"node-resolver-k4h57\" (UID: \"af3b9fa5-b5eb-41b5-b21f-c3983847fb50\") " pod="openshift-dns/node-resolver-k4h57"
Sep 14 09:43:05.767795 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767369    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/016118b7-1766-41e1-9d3a-2ae2cc9c187c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8xhxq\" (UID: \"016118b7-1766-41e1-9d3a-2ae2cc9c187c\") " pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.767795 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767302    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af3b9fa5-b5eb-41b5-b21f-c3983847fb50-hosts-file\") pod \"node-resolver-k4h57\" (UID: \"af3b9fa5-b5eb-41b5-b21f-c3983847fb50\") " pod="openshift-dns/node-resolver-k4h57"
Sep 14 09:43:05.767795 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:05.767372    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 09:43:05.767795 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767392    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-var-lib-openvswitch\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.767795 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767417    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-run-ovn\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.767795 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:05.767445    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret podName:684f63fb-ee2f-41ac-a26b-759fa9c2d043 nodeName:}" failed. No retries permitted until 2026-09-14 09:43:06.267421143 +0000 UTC m=+2.125653479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret") pod "global-pull-secret-syncer-4rsn7" (UID: "684f63fb-ee2f-41ac-a26b-759fa9c2d043") : object "kube-system"/"original-pull-secret" not registered
Sep 14 09:43:05.767795 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767453    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-run-ovn\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.767795 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767477    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-node-log\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.767795 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767493    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-var-lib-openvswitch\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.767795 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767502    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-run-systemd\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.767795 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767525    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-log-socket\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.767795 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767548    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-host-cni-netd\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.767795 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767572    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/00d21667-eb67-4fd8-bdaa-7f2935e6e131-ovnkube-script-lib\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.767795 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767598    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/016118b7-1766-41e1-9d3a-2ae2cc9c187c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8xhxq\" (UID: \"016118b7-1766-41e1-9d3a-2ae2cc9c187c\") " pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.767795 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767625    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-log-socket\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.767795 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767653    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-host-cni-bin\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.767795 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767670    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-node-log\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.768591 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767683    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/684f63fb-ee2f-41ac-a26b-759fa9c2d043-kubelet-config\") pod \"global-pull-secret-syncer-4rsn7\" (UID: \"684f63fb-ee2f-41ac-a26b-759fa9c2d043\") " pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:05.768591 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767699    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-run-systemd\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.768591 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767728    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/016118b7-1766-41e1-9d3a-2ae2cc9c187c-cnibin\") pod \"multus-additional-cni-plugins-8xhxq\" (UID: \"016118b7-1766-41e1-9d3a-2ae2cc9c187c\") " pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.768591 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767741    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/00d21667-eb67-4fd8-bdaa-7f2935e6e131-env-overrides\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.768591 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-systemd-units\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.768591 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767766    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-host-cni-netd\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.768591 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-host-run-ovn-kubernetes\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.768591 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767801    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-host-cni-bin\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.768591 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767802    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-systemd-units\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.768591 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767808    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/66a14d90-706e-47be-b9bb-2adeb65103bf-serviceca\") pod \"node-ca-c2bz4\" (UID: \"66a14d90-706e-47be-b9bb-2adeb65103bf\") " pod="openshift-image-registry/node-ca-c2bz4"
Sep 14 09:43:05.768591 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767815    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/00d21667-eb67-4fd8-bdaa-7f2935e6e131-ovnkube-config\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.768591 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767841    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/684f63fb-ee2f-41ac-a26b-759fa9c2d043-kubelet-config\") pod \"global-pull-secret-syncer-4rsn7\" (UID: \"684f63fb-ee2f-41ac-a26b-759fa9c2d043\") " pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:05.768591 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66a14d90-706e-47be-b9bb-2adeb65103bf-host\") pod \"node-ca-c2bz4\" (UID: \"66a14d90-706e-47be-b9bb-2adeb65103bf\") " pod="openshift-image-registry/node-ca-c2bz4"
Sep 14 09:43:05.768591 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767872    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-host-run-ovn-kubernetes\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.768591 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/016118b7-1766-41e1-9d3a-2ae2cc9c187c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8xhxq\" (UID: \"016118b7-1766-41e1-9d3a-2ae2cc9c187c\") " pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.768591 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767894    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/016118b7-1766-41e1-9d3a-2ae2cc9c187c-cni-binary-copy\") pod \"multus-additional-cni-plugins-8xhxq\" (UID: \"016118b7-1766-41e1-9d3a-2ae2cc9c187c\") " pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.768591 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767885    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/016118b7-1766-41e1-9d3a-2ae2cc9c187c-cnibin\") pod \"multus-additional-cni-plugins-8xhxq\" (UID: \"016118b7-1766-41e1-9d3a-2ae2cc9c187c\") " pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.769490 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767918    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66a14d90-706e-47be-b9bb-2adeb65103bf-host\") pod \"node-ca-c2bz4\" (UID: \"66a14d90-706e-47be-b9bb-2adeb65103bf\") " pod="openshift-image-registry/node-ca-c2bz4"
Sep 14 09:43:05.769490 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af3b9fa5-b5eb-41b5-b21f-c3983847fb50-tmp-dir\") pod \"node-resolver-k4h57\" (UID: \"af3b9fa5-b5eb-41b5-b21f-c3983847fb50\") " pod="openshift-dns/node-resolver-k4h57"
Sep 14 09:43:05.769490 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767974    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-host-slash\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.769490 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.767997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.769490 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.768027    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/016118b7-1766-41e1-9d3a-2ae2cc9c187c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8xhxq\" (UID: \"016118b7-1766-41e1-9d3a-2ae2cc9c187c\") " pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.769490 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.768038    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.769490 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.768069    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-host-slash\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.769490 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.768091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-etc-openvswitch\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.769490 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.768111    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/016118b7-1766-41e1-9d3a-2ae2cc9c187c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8xhxq\" (UID: \"016118b7-1766-41e1-9d3a-2ae2cc9c187c\") " pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.769490 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.768140    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-host-kubelet\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.769490 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.768165    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59mwj\" (UniqueName: \"kubernetes.io/projected/66a14d90-706e-47be-b9bb-2adeb65103bf-kube-api-access-59mwj\") pod \"node-ca-c2bz4\" (UID: \"66a14d90-706e-47be-b9bb-2adeb65103bf\") " pod="openshift-image-registry/node-ca-c2bz4"
Sep 14 09:43:05.769490 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.768190    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/016118b7-1766-41e1-9d3a-2ae2cc9c187c-system-cni-dir\") pod \"multus-additional-cni-plugins-8xhxq\" (UID: \"016118b7-1766-41e1-9d3a-2ae2cc9c187c\") " pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.769490 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.768204    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/00d21667-eb67-4fd8-bdaa-7f2935e6e131-ovnkube-script-lib\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.769490 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.768213    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-host-run-netns\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.769490 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.768254    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-host-run-netns\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.769490 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.768261    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/016118b7-1766-41e1-9d3a-2ae2cc9c187c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8xhxq\" (UID: \"016118b7-1766-41e1-9d3a-2ae2cc9c187c\") " pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.769490 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.768263    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af3b9fa5-b5eb-41b5-b21f-c3983847fb50-tmp-dir\") pod \"node-resolver-k4h57\" (UID: \"af3b9fa5-b5eb-41b5-b21f-c3983847fb50\") " pod="openshift-dns/node-resolver-k4h57"
Sep 14 09:43:05.770111 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.768304    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-host-kubelet\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.770111 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.768318    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00d21667-eb67-4fd8-bdaa-7f2935e6e131-etc-openvswitch\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.770111 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.768308    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/016118b7-1766-41e1-9d3a-2ae2cc9c187c-system-cni-dir\") pod \"multus-additional-cni-plugins-8xhxq\" (UID: \"016118b7-1766-41e1-9d3a-2ae2cc9c187c\") " pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.770111 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.768358    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/00d21667-eb67-4fd8-bdaa-7f2935e6e131-ovnkube-config\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.770111 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.768493    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/016118b7-1766-41e1-9d3a-2ae2cc9c187c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8xhxq\" (UID: \"016118b7-1766-41e1-9d3a-2ae2cc9c187c\") " pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.770111 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.769959    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/00d21667-eb67-4fd8-bdaa-7f2935e6e131-ovn-node-metrics-cert\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.789453 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.789419    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gg7g\" (UniqueName: \"kubernetes.io/projected/af3b9fa5-b5eb-41b5-b21f-c3983847fb50-kube-api-access-6gg7g\") pod \"node-resolver-k4h57\" (UID: \"af3b9fa5-b5eb-41b5-b21f-c3983847fb50\") " pod="openshift-dns/node-resolver-k4h57"
Sep 14 09:43:05.789574 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:05.789542    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 09:43:05.789574 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:05.789565    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 09:43:05.789698 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:05.789581    2581 projected.go:196] Error preparing data for projected volume kube-api-access-9864x for pod openshift-network-diagnostics/network-check-target-rfwwn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 09:43:05.789698 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:05.789656    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x podName:988fb8db-aad4-41fb-b072-6441acaf7135 nodeName:}" failed. No retries permitted until 2026-09-14 09:43:06.289636173 +0000 UTC m=+2.147868515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9864x" (UniqueName: "kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x") pod "network-check-target-rfwwn" (UID: "988fb8db-aad4-41fb-b072-6441acaf7135") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 09:43:05.790308 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.790110    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59mwj\" (UniqueName: \"kubernetes.io/projected/66a14d90-706e-47be-b9bb-2adeb65103bf-kube-api-access-59mwj\") pod \"node-ca-c2bz4\" (UID: \"66a14d90-706e-47be-b9bb-2adeb65103bf\") " pod="openshift-image-registry/node-ca-c2bz4"
Sep 14 09:43:05.790485 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.790465    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59clw\" (UniqueName: \"kubernetes.io/projected/016118b7-1766-41e1-9d3a-2ae2cc9c187c-kube-api-access-59clw\") pod \"multus-additional-cni-plugins-8xhxq\" (UID: \"016118b7-1766-41e1-9d3a-2ae2cc9c187c\") " pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.790926 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.790906    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnk8h\" (UniqueName: \"kubernetes.io/projected/00d21667-eb67-4fd8-bdaa-7f2935e6e131-kube-api-access-tnk8h\") pod \"ovnkube-node-qmq8t\" (UID: \"00d21667-eb67-4fd8-bdaa-7f2935e6e131\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.870155 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.870092    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pnznq"
Sep 14 09:43:05.880486 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:05.880462    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e4bd39b_b3ae_4b10_ad3a_67c87e399fed.slice/crio-d8ef0b4ae7f4ca2b348d51226a3ce473adde054c82ee345bd01c08be4522bf0b WatchSource:0}: Error finding container d8ef0b4ae7f4ca2b348d51226a3ce473adde054c82ee345bd01c08be4522bf0b: Status 404 returned error can't find the container with id d8ef0b4ae7f4ca2b348d51226a3ce473adde054c82ee345bd01c08be4522bf0b
Sep 14 09:43:05.883853 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.883784    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg"
Sep 14 09:43:05.891762 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:05.891737    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode46b7233_8686_456c_9d0b_fad99d708742.slice/crio-37fcd3cd144593a9582423d778587e28af5eea62c2781fab7d4fffcab3e640c0 WatchSource:0}: Error finding container 37fcd3cd144593a9582423d778587e28af5eea62c2781fab7d4fffcab3e640c0: Status 404 returned error can't find the container with id 37fcd3cd144593a9582423d778587e28af5eea62c2781fab7d4fffcab3e640c0
Sep 14 09:43:05.899035 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.899015    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-grhmb"
Sep 14 09:43:05.900125 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.900110    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bq5mf"
Sep 14 09:43:05.907413 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:05.907394    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5da0c88c_eed9_4a80_aa60_df7da11033cc.slice/crio-aad96c05bac290d36f0b5cc2f62e34151acf406ec83e6769552c9eb775430988 WatchSource:0}: Error finding container aad96c05bac290d36f0b5cc2f62e34151acf406ec83e6769552c9eb775430988: Status 404 returned error can't find the container with id aad96c05bac290d36f0b5cc2f62e34151acf406ec83e6769552c9eb775430988
Sep 14 09:43:05.910060 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:05.910037    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc48a8e26_29cb_441e_a59e_cc9ef5edcf1f.slice/crio-d5c3ff66993668904fcd3469dd0b99e7a2f75366c5e4c7403c18558929b8e522 WatchSource:0}: Error finding container d5c3ff66993668904fcd3469dd0b99e7a2f75366c5e4c7403c18558929b8e522: Status 404 returned error can't find the container with id d5c3ff66993668904fcd3469dd0b99e7a2f75366c5e4c7403c18558929b8e522
Sep 14 09:43:05.932289 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.932262    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bsbms"
Sep 14 09:43:05.941951 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:05.941925    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba40a4a_c919_4386_97eb_392cad6cf6d1.slice/crio-173a4f805580b0fe67c7f2559495e91bfc4f89db673da8b3e8667a5989b8b586 WatchSource:0}: Error finding container 173a4f805580b0fe67c7f2559495e91bfc4f89db673da8b3e8667a5989b8b586: Status 404 returned error can't find the container with id 173a4f805580b0fe67c7f2559495e91bfc4f89db673da8b3e8667a5989b8b586
Sep 14 09:43:05.950836 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.950817    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k4h57"
Sep 14 09:43:05.958803 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:05.958784    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf3b9fa5_b5eb_41b5_b21f_c3983847fb50.slice/crio-0693e3d283295569baaffe85ea7fc194e9bce1be00159aba949562c55bba5482 WatchSource:0}: Error finding container 0693e3d283295569baaffe85ea7fc194e9bce1be00159aba949562c55bba5482: Status 404 returned error can't find the container with id 0693e3d283295569baaffe85ea7fc194e9bce1be00159aba949562c55bba5482
Sep 14 09:43:05.969612 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.969592    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c2bz4"
Sep 14 09:43:05.977443 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:05.977424    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66a14d90_706e_47be_b9bb_2adeb65103bf.slice/crio-517f7851f609dc5a66bc71d9f12871f828658ed19505e712de9a31c7d62fc3e5 WatchSource:0}: Error finding container 517f7851f609dc5a66bc71d9f12871f828658ed19505e712de9a31c7d62fc3e5: Status 404 returned error can't find the container with id 517f7851f609dc5a66bc71d9f12871f828658ed19505e712de9a31c7d62fc3e5
Sep 14 09:43:05.978539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.978521    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8xhxq"
Sep 14 09:43:05.983150 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:05.983134    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:05.987255 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:05.987238    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod016118b7_1766_41e1_9d3a_2ae2cc9c187c.slice/crio-a4740f0b436ea82f7af9624301b3e7aa84a6599c31e55a592568553726199a97 WatchSource:0}: Error finding container a4740f0b436ea82f7af9624301b3e7aa84a6599c31e55a592568553726199a97: Status 404 returned error can't find the container with id a4740f0b436ea82f7af9624301b3e7aa84a6599c31e55a592568553726199a97
Sep 14 09:43:05.991475 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:05.991452    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d21667_eb67_4fd8_bdaa_7f2935e6e131.slice/crio-c4590e9718bd7ab904a198b87b82f51882b056a3c228dfb8c86728713fa8396d WatchSource:0}: Error finding container c4590e9718bd7ab904a198b87b82f51882b056a3c228dfb8c86728713fa8396d: Status 404 returned error can't find the container with id c4590e9718bd7ab904a198b87b82f51882b056a3c228dfb8c86728713fa8396d
Sep 14 09:43:06.170894 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:06.170817    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs\") pod \"network-metrics-daemon-wlcmj\" (UID: \"930e6273-c402-447a-ade0-f00b6248df0d\") " pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:06.171048 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:06.170955    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 09:43:06.171048 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:06.171029    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs podName:930e6273-c402-447a-ade0-f00b6248df0d nodeName:}" failed. No retries permitted until 2026-09-14 09:43:07.171008974 +0000 UTC m=+3.029241310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs") pod "network-metrics-daemon-wlcmj" (UID: "930e6273-c402-447a-ade0-f00b6248df0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 09:43:06.271925 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:06.271883    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret\") pod \"global-pull-secret-syncer-4rsn7\" (UID: \"684f63fb-ee2f-41ac-a26b-759fa9c2d043\") " pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:06.272101 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:06.272048    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 09:43:06.272163 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:06.272109    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret podName:684f63fb-ee2f-41ac-a26b-759fa9c2d043 nodeName:}" failed. No retries permitted until 2026-09-14 09:43:07.272091436 +0000 UTC m=+3.130323785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret") pod "global-pull-secret-syncer-4rsn7" (UID: "684f63fb-ee2f-41ac-a26b-759fa9c2d043") : object "kube-system"/"original-pull-secret" not registered
Sep 14 09:43:06.372357 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:06.372321    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9864x\" (UniqueName: \"kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x\") pod \"network-check-target-rfwwn\" (UID: \"988fb8db-aad4-41fb-b072-6441acaf7135\") " pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:06.372535 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:06.372505    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 09:43:06.372535 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:06.372530    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 09:43:06.372652 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:06.372544    2581 projected.go:196] Error preparing data for projected volume kube-api-access-9864x for pod openshift-network-diagnostics/network-check-target-rfwwn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 09:43:06.372652 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:06.372605    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x podName:988fb8db-aad4-41fb-b072-6441acaf7135 nodeName:}" failed. No retries permitted until 2026-09-14 09:43:07.372583823 +0000 UTC m=+3.230816161 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9864x" (UniqueName: "kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x") pod "network-check-target-rfwwn" (UID: "988fb8db-aad4-41fb-b072-6441acaf7135") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 09:43:06.650748 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:06.648969    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-13 09:38:05 +0000 UTC" deadline="2028-03-29 19:09:19.905029159 +0000 UTC"
Sep 14 09:43:06.650748 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:06.649013    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13497h26m13.256021658s"
Sep 14 09:43:06.672724 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:06.672652    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bsbms" event={"ID":"4ba40a4a-c919-4386-97eb-392cad6cf6d1","Type":"ContainerStarted","Data":"173a4f805580b0fe67c7f2559495e91bfc4f89db673da8b3e8667a5989b8b586"}
Sep 14 09:43:06.678728 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:06.678678    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bq5mf" event={"ID":"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f","Type":"ContainerStarted","Data":"d5c3ff66993668904fcd3469dd0b99e7a2f75366c5e4c7403c18558929b8e522"}
Sep 14 09:43:06.686059 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:06.686022    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-grhmb" event={"ID":"5da0c88c-eed9-4a80-aa60-df7da11033cc","Type":"ContainerStarted","Data":"aad96c05bac290d36f0b5cc2f62e34151acf406ec83e6769552c9eb775430988"}
Sep 14 09:43:06.693246 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:06.693175    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-247.ec2.internal" event={"ID":"f6a8db1d929676593bd9a89c05273daf","Type":"ContainerStarted","Data":"b060244c82733332590742a7523b058bd2d110641349b5f707c43b3fb82721a8"}
Sep 14 09:43:06.701381 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:06.701352    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xhxq" event={"ID":"016118b7-1766-41e1-9d3a-2ae2cc9c187c","Type":"ContainerStarted","Data":"a4740f0b436ea82f7af9624301b3e7aa84a6599c31e55a592568553726199a97"}
Sep 14 09:43:06.708388 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:06.708304    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c2bz4" event={"ID":"66a14d90-706e-47be-b9bb-2adeb65103bf","Type":"ContainerStarted","Data":"517f7851f609dc5a66bc71d9f12871f828658ed19505e712de9a31c7d62fc3e5"}
Sep 14 09:43:06.713823 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:06.713738    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg" event={"ID":"e46b7233-8686-456c-9d0b-fad99d708742","Type":"ContainerStarted","Data":"37fcd3cd144593a9582423d778587e28af5eea62c2781fab7d4fffcab3e640c0"}
Sep 14 09:43:06.725216 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:06.725140    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pnznq" event={"ID":"7e4bd39b-b3ae-4b10-ad3a-67c87e399fed","Type":"ContainerStarted","Data":"d8ef0b4ae7f4ca2b348d51226a3ce473adde054c82ee345bd01c08be4522bf0b"}
Sep 14 09:43:06.737295 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:06.737265    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-247.ec2.internal" event={"ID":"4c9742fcc68c982c9ec23fd7b6742875","Type":"ContainerStarted","Data":"29ca21cfd7a8b623ccb226760003204222146636cda6da4034b443f01727e150"}
Sep 14 09:43:06.750022 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:06.749984    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t" event={"ID":"00d21667-eb67-4fd8-bdaa-7f2935e6e131","Type":"ContainerStarted","Data":"c4590e9718bd7ab904a198b87b82f51882b056a3c228dfb8c86728713fa8396d"}
Sep 14 09:43:06.761214 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:06.761177    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k4h57" event={"ID":"af3b9fa5-b5eb-41b5-b21f-c3983847fb50","Type":"ContainerStarted","Data":"0693e3d283295569baaffe85ea7fc194e9bce1be00159aba949562c55bba5482"}
Sep 14 09:43:07.179326 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:07.178723    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs\") pod \"network-metrics-daemon-wlcmj\" (UID: \"930e6273-c402-447a-ade0-f00b6248df0d\") " pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:07.179326 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:07.178932    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 09:43:07.179326 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:07.178994    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs podName:930e6273-c402-447a-ade0-f00b6248df0d nodeName:}" failed. No retries permitted until 2026-09-14 09:43:09.178975526 +0000 UTC m=+5.037207864 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs") pod "network-metrics-daemon-wlcmj" (UID: "930e6273-c402-447a-ade0-f00b6248df0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 09:43:07.279967 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:07.279922    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret\") pod \"global-pull-secret-syncer-4rsn7\" (UID: \"684f63fb-ee2f-41ac-a26b-759fa9c2d043\") " pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:07.280158 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:07.280140    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 09:43:07.280217 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:07.280205    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret podName:684f63fb-ee2f-41ac-a26b-759fa9c2d043 nodeName:}" failed. No retries permitted until 2026-09-14 09:43:09.280187632 +0000 UTC m=+5.138419984 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret") pod "global-pull-secret-syncer-4rsn7" (UID: "684f63fb-ee2f-41ac-a26b-759fa9c2d043") : object "kube-system"/"original-pull-secret" not registered
Sep 14 09:43:07.381344 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:07.381301    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9864x\" (UniqueName: \"kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x\") pod \"network-check-target-rfwwn\" (UID: \"988fb8db-aad4-41fb-b072-6441acaf7135\") " pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:07.381513 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:07.381492    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 09:43:07.381513 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:07.381511    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 09:43:07.381638 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:07.381524    2581 projected.go:196] Error preparing data for projected volume kube-api-access-9864x for pod openshift-network-diagnostics/network-check-target-rfwwn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 09:43:07.381638 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:07.381582    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x podName:988fb8db-aad4-41fb-b072-6441acaf7135 nodeName:}" failed. No retries permitted until 2026-09-14 09:43:09.381564906 +0000 UTC m=+5.239797258 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9864x" (UniqueName: "kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x") pod "network-check-target-rfwwn" (UID: "988fb8db-aad4-41fb-b072-6441acaf7135") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 09:43:07.650289 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:07.650203    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:07.650459 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:07.650337    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfwwn" podUID="988fb8db-aad4-41fb-b072-6441acaf7135"
Sep 14 09:43:07.651143 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:07.650808    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:07.651143 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:07.650921    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlcmj" podUID="930e6273-c402-447a-ade0-f00b6248df0d"
Sep 14 09:43:07.651143 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:07.650989    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-13 09:38:05 +0000 UTC" deadline="2028-03-16 14:43:20.138739218 +0000 UTC"
Sep 14 09:43:07.651143 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:07.651028    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13181h0m12.487714378s"
Sep 14 09:43:07.651965 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:07.651770    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:07.651965 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:07.651883    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rsn7" podUID="684f63fb-ee2f-41ac-a26b-759fa9c2d043"
Sep 14 09:43:09.204002 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:09.203751    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs\") pod \"network-metrics-daemon-wlcmj\" (UID: \"930e6273-c402-447a-ade0-f00b6248df0d\") " pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:09.204456 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:09.204127    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 09:43:09.204456 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:09.204198    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs podName:930e6273-c402-447a-ade0-f00b6248df0d nodeName:}" failed. No retries permitted until 2026-09-14 09:43:13.204177631 +0000 UTC m=+9.062409984 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs") pod "network-metrics-daemon-wlcmj" (UID: "930e6273-c402-447a-ade0-f00b6248df0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 09:43:09.305360 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:09.304691    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret\") pod \"global-pull-secret-syncer-4rsn7\" (UID: \"684f63fb-ee2f-41ac-a26b-759fa9c2d043\") " pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:09.305360 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:09.304876    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 09:43:09.305360 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:09.304942    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret podName:684f63fb-ee2f-41ac-a26b-759fa9c2d043 nodeName:}" failed. No retries permitted until 2026-09-14 09:43:13.30492351 +0000 UTC m=+9.163155849 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret") pod "global-pull-secret-syncer-4rsn7" (UID: "684f63fb-ee2f-41ac-a26b-759fa9c2d043") : object "kube-system"/"original-pull-secret" not registered
Sep 14 09:43:09.406233 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:09.406153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9864x\" (UniqueName: \"kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x\") pod \"network-check-target-rfwwn\" (UID: \"988fb8db-aad4-41fb-b072-6441acaf7135\") " pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:09.406402 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:09.406327    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 09:43:09.406402 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:09.406347    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 09:43:09.406402 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:09.406359    2581 projected.go:196] Error preparing data for projected volume kube-api-access-9864x for pod openshift-network-diagnostics/network-check-target-rfwwn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 09:43:09.406567 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:09.406458    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x podName:988fb8db-aad4-41fb-b072-6441acaf7135 nodeName:}" failed. No retries permitted until 2026-09-14 09:43:13.406404883 +0000 UTC m=+9.264637228 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9864x" (UniqueName: "kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x") pod "network-check-target-rfwwn" (UID: "988fb8db-aad4-41fb-b072-6441acaf7135") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 09:43:09.650089 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:09.649981    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:09.650089 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:09.650022    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:09.650089 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:09.650023    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:09.650356 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:09.650118    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfwwn" podUID="988fb8db-aad4-41fb-b072-6441acaf7135"
Sep 14 09:43:09.650356 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:09.650213    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rsn7" podUID="684f63fb-ee2f-41ac-a26b-759fa9c2d043"
Sep 14 09:43:09.650356 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:09.650322    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlcmj" podUID="930e6273-c402-447a-ade0-f00b6248df0d"
Sep 14 09:43:11.649400 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:11.649364    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:11.649870 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:11.649411    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:11.649870 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:11.649411    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:11.649870 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:11.649482    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfwwn" podUID="988fb8db-aad4-41fb-b072-6441acaf7135"
Sep 14 09:43:11.649870 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:11.649648    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlcmj" podUID="930e6273-c402-447a-ade0-f00b6248df0d"
Sep 14 09:43:11.649870 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:11.649751    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rsn7" podUID="684f63fb-ee2f-41ac-a26b-759fa9c2d043"
Sep 14 09:43:13.240217 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:13.240180    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs\") pod \"network-metrics-daemon-wlcmj\" (UID: \"930e6273-c402-447a-ade0-f00b6248df0d\") " pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:13.240703 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:13.240294    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 09:43:13.240703 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:13.240343    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs podName:930e6273-c402-447a-ade0-f00b6248df0d nodeName:}" failed. No retries permitted until 2026-09-14 09:43:21.240329418 +0000 UTC m=+17.098561752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs") pod "network-metrics-daemon-wlcmj" (UID: "930e6273-c402-447a-ade0-f00b6248df0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 09:43:13.340701 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:13.340658    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret\") pod \"global-pull-secret-syncer-4rsn7\" (UID: \"684f63fb-ee2f-41ac-a26b-759fa9c2d043\") " pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:13.340905 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:13.340789    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 09:43:13.340905 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:13.340873    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret podName:684f63fb-ee2f-41ac-a26b-759fa9c2d043 nodeName:}" failed. No retries permitted until 2026-09-14 09:43:21.340854181 +0000 UTC m=+17.199086518 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret") pod "global-pull-secret-syncer-4rsn7" (UID: "684f63fb-ee2f-41ac-a26b-759fa9c2d043") : object "kube-system"/"original-pull-secret" not registered
Sep 14 09:43:13.442149 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:13.442105    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9864x\" (UniqueName: \"kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x\") pod \"network-check-target-rfwwn\" (UID: \"988fb8db-aad4-41fb-b072-6441acaf7135\") " pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:13.442332 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:13.442314    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 09:43:13.442379 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:13.442342    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 09:43:13.442379 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:13.442357    2581 projected.go:196] Error preparing data for projected volume kube-api-access-9864x for pod openshift-network-diagnostics/network-check-target-rfwwn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 09:43:13.442443 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:13.442419    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x podName:988fb8db-aad4-41fb-b072-6441acaf7135 nodeName:}" failed. No retries permitted until 2026-09-14 09:43:21.442399391 +0000 UTC m=+17.300631733 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9864x" (UniqueName: "kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x") pod "network-check-target-rfwwn" (UID: "988fb8db-aad4-41fb-b072-6441acaf7135") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 09:43:13.650066 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:13.649933    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:13.650066 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:13.649961    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:13.650066 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:13.649950    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:13.650338 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:13.650098    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlcmj" podUID="930e6273-c402-447a-ade0-f00b6248df0d"
Sep 14 09:43:13.650338 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:13.650159    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfwwn" podUID="988fb8db-aad4-41fb-b072-6441acaf7135"
Sep 14 09:43:13.650338 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:13.650258    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rsn7" podUID="684f63fb-ee2f-41ac-a26b-759fa9c2d043"
Sep 14 09:43:15.649398 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:15.649325    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:15.649845 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:15.649325    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:15.649845 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:15.649481    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlcmj" podUID="930e6273-c402-447a-ade0-f00b6248df0d"
Sep 14 09:43:15.649845 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:15.649325    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:15.649845 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:15.649554    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rsn7" podUID="684f63fb-ee2f-41ac-a26b-759fa9c2d043"
Sep 14 09:43:15.649845 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:15.649742    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfwwn" podUID="988fb8db-aad4-41fb-b072-6441acaf7135"
Sep 14 09:43:17.649643 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:17.649552    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:17.649643 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:17.649608    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:17.650158 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:17.649668    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:17.650158 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:17.649686    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfwwn" podUID="988fb8db-aad4-41fb-b072-6441acaf7135"
Sep 14 09:43:17.650158 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:17.649796    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlcmj" podUID="930e6273-c402-447a-ade0-f00b6248df0d"
Sep 14 09:43:17.650158 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:17.649870    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rsn7" podUID="684f63fb-ee2f-41ac-a26b-759fa9c2d043"
Sep 14 09:43:19.650215 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:19.650171    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:19.650215 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:19.650192    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:19.650215 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:19.650221    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:19.650779 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:19.650296    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rsn7" podUID="684f63fb-ee2f-41ac-a26b-759fa9c2d043"
Sep 14 09:43:19.650779 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:19.650438    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfwwn" podUID="988fb8db-aad4-41fb-b072-6441acaf7135"
Sep 14 09:43:19.650779 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:19.650539    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlcmj" podUID="930e6273-c402-447a-ade0-f00b6248df0d"
Sep 14 09:43:21.299962 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:21.299932    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs\") pod \"network-metrics-daemon-wlcmj\" (UID: \"930e6273-c402-447a-ade0-f00b6248df0d\") " pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:21.300380 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:21.300053    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 09:43:21.300380 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:21.300105    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs podName:930e6273-c402-447a-ade0-f00b6248df0d nodeName:}" failed. No retries permitted until 2026-09-14 09:43:37.300090573 +0000 UTC m=+33.158322911 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs") pod "network-metrics-daemon-wlcmj" (UID: "930e6273-c402-447a-ade0-f00b6248df0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 09:43:21.401114 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:21.401078    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret\") pod \"global-pull-secret-syncer-4rsn7\" (UID: \"684f63fb-ee2f-41ac-a26b-759fa9c2d043\") " pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:21.401315 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:21.401226    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 09:43:21.401315 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:21.401284    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret podName:684f63fb-ee2f-41ac-a26b-759fa9c2d043 nodeName:}" failed. No retries permitted until 2026-09-14 09:43:37.401267472 +0000 UTC m=+33.259499809 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret") pod "global-pull-secret-syncer-4rsn7" (UID: "684f63fb-ee2f-41ac-a26b-759fa9c2d043") : object "kube-system"/"original-pull-secret" not registered
Sep 14 09:43:21.501703 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:21.501660    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9864x\" (UniqueName: \"kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x\") pod \"network-check-target-rfwwn\" (UID: \"988fb8db-aad4-41fb-b072-6441acaf7135\") " pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:21.501931 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:21.501858    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 09:43:21.501931 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:21.501883    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 09:43:21.501931 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:21.501897    2581 projected.go:196] Error preparing data for projected volume kube-api-access-9864x for pod openshift-network-diagnostics/network-check-target-rfwwn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 09:43:21.502086 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:21.501951    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x podName:988fb8db-aad4-41fb-b072-6441acaf7135 nodeName:}" failed. No retries permitted until 2026-09-14 09:43:37.501935154 +0000 UTC m=+33.360167502 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9864x" (UniqueName: "kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x") pod "network-check-target-rfwwn" (UID: "988fb8db-aad4-41fb-b072-6441acaf7135") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 09:43:21.649469 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:21.649365    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:21.649469 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:21.649400    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:21.649469 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:21.649400    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:21.649796 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:21.649505    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfwwn" podUID="988fb8db-aad4-41fb-b072-6441acaf7135"
Sep 14 09:43:21.649796 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:21.649566    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rsn7" podUID="684f63fb-ee2f-41ac-a26b-759fa9c2d043"
Sep 14 09:43:21.649796 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:21.649671    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlcmj" podUID="930e6273-c402-447a-ade0-f00b6248df0d"
Sep 14 09:43:23.649595 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:23.649557    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:23.650155 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:23.649605    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:23.650155 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:23.649605    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:23.650155 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:23.649673    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfwwn" podUID="988fb8db-aad4-41fb-b072-6441acaf7135"
Sep 14 09:43:23.650155 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:23.649807    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlcmj" podUID="930e6273-c402-447a-ade0-f00b6248df0d"
Sep 14 09:43:23.650155 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:23.649902    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rsn7" podUID="684f63fb-ee2f-41ac-a26b-759fa9c2d043"
Sep 14 09:43:25.649478 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:25.649276    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:25.650108 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:25.649409    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:25.650108 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:25.649588    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfwwn" podUID="988fb8db-aad4-41fb-b072-6441acaf7135"
Sep 14 09:43:25.650108 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:25.649450    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:25.650108 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:25.649679    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rsn7" podUID="684f63fb-ee2f-41ac-a26b-759fa9c2d043"
Sep 14 09:43:25.650108 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:25.649875    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlcmj" podUID="930e6273-c402-447a-ade0-f00b6248df0d"
Sep 14 09:43:25.822950 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:25.822744    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t" event={"ID":"00d21667-eb67-4fd8-bdaa-7f2935e6e131","Type":"ContainerStarted","Data":"3e6a2669c14e35c50904db8a0ca4f9f90e8c4fd497171e0f35e5b7a277b2b09c"}
Sep 14 09:43:25.823102 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:25.822998    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t" event={"ID":"00d21667-eb67-4fd8-bdaa-7f2935e6e131","Type":"ContainerStarted","Data":"04c4986400a11c014f65693a052bce2bbee4527592392381ec935d655ea0eafa"}
Sep 14 09:43:25.824211 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:25.824188    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k4h57" event={"ID":"af3b9fa5-b5eb-41b5-b21f-c3983847fb50","Type":"ContainerStarted","Data":"117fda4e632e4c416973ad5c849052b2443a55a9de30334761c7ad654b5396b6"}
Sep 14 09:43:25.825626 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:25.825607    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bq5mf" event={"ID":"c48a8e26-29cb-441e-a59e-cc9ef5edcf1f","Type":"ContainerStarted","Data":"156265c77109d8d14f4f5593a2e6ff5fe89b63dd0ad0e66eca1e974d05f7d789"}
Sep 14 09:43:25.826987 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:25.826964    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-grhmb" event={"ID":"5da0c88c-eed9-4a80-aa60-df7da11033cc","Type":"ContainerStarted","Data":"c0bf6ebfea89ff291ad537e5653b8b6e33dcc4df0cfceb703344131e7ab1338f"}
Sep 14 09:43:25.828374 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:25.828354    2581 generic.go:356] "Generic (PLEG): container finished" podID="f6a8db1d929676593bd9a89c05273daf" containerID="1a278a94db481c715006c3d112d6c1a23ba536d3a57bbda80af7f6126ea5f4e3" exitCode=0
Sep 14 09:43:25.828473 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:25.828409    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-247.ec2.internal" event={"ID":"f6a8db1d929676593bd9a89c05273daf","Type":"ContainerDied","Data":"1a278a94db481c715006c3d112d6c1a23ba536d3a57bbda80af7f6126ea5f4e3"}
Sep 14 09:43:25.831848 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:25.831778    2581 generic.go:356] "Generic (PLEG): container finished" podID="016118b7-1766-41e1-9d3a-2ae2cc9c187c" containerID="098d9c5bd0f4ca16cc585bc78c6a1cd51873e33f59c6451d22d7c4c2e85c9a09" exitCode=0
Sep 14 09:43:25.831966 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:25.831949    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xhxq" event={"ID":"016118b7-1766-41e1-9d3a-2ae2cc9c187c","Type":"ContainerDied","Data":"098d9c5bd0f4ca16cc585bc78c6a1cd51873e33f59c6451d22d7c4c2e85c9a09"}
Sep 14 09:43:25.834258 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:25.834234    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c2bz4" event={"ID":"66a14d90-706e-47be-b9bb-2adeb65103bf","Type":"ContainerStarted","Data":"262e2259fcd29f223988739ec57e68bc0e3f05704995185d4918e572012a7832"}
Sep 14 09:43:25.835844 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:25.835820    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg" event={"ID":"e46b7233-8686-456c-9d0b-fad99d708742","Type":"ContainerStarted","Data":"3405b6fbeb458515055a5622a8199acf45b5272025ab27a1edd3cf1e181e0211"}
Sep 14 09:43:25.837454 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:25.837433    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pnznq" event={"ID":"7e4bd39b-b3ae-4b10-ad3a-67c87e399fed","Type":"ContainerStarted","Data":"25d5c9894248877275f10245d0f5e868a0f0630989cae9c61fba50fe6b89a09c"}
Sep 14 09:43:25.839328 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:25.839307    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-247.ec2.internal" event={"ID":"4c9742fcc68c982c9ec23fd7b6742875","Type":"ContainerStarted","Data":"c2da4e5931f0b05155a775d0bbc1217abad8927a51746c3731d20a2c4afd23b7"}
Sep 14 09:43:25.852290 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:25.852243    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-k4h57" podStartSLOduration=3.010645029 podStartE2EDuration="21.85222664s" totalImagesPullingTime="18.841581611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:43:25.851554191 +0000 UTC m=+21.709786548" watchObservedRunningTime="2026-09-14 09:43:25.85222664 +0000 UTC m=+21.710458996"
Sep 14 09:43:25.937681 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:25.935789    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-247.ec2.internal" podStartSLOduration=20.935770221 podStartE2EDuration="20.935770221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:43:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:43:25.906060019 +0000 UTC m=+21.764292376" watchObservedRunningTime="2026-09-14 09:43:25.935770221 +0000 UTC m=+21.794002604"
Sep 14 09:43:25.955764 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:25.955725    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bq5mf" podStartSLOduration=3.065419596 podStartE2EDuration="21.955693836s" totalImagesPullingTime="18.89027424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:43:25.938187222 +0000 UTC m=+21.796419578" watchObservedRunningTime="2026-09-14 09:43:25.955693836 +0000 UTC m=+21.813926169"
Sep 14 09:43:25.955984 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:25.955965    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c2bz4" podStartSLOduration=3.269537857 podStartE2EDuration="21.955959969s" totalImagesPullingTime="18.686422112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:43:25.955907816 +0000 UTC m=+21.814140174" watchObservedRunningTime="2026-09-14 09:43:25.955959969 +0000 UTC m=+21.814192322"
Sep 14 09:43:25.992120 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:25.992061    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pnznq" podStartSLOduration=3.209369304 podStartE2EDuration="21.992039284s" totalImagesPullingTime="18.78266998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:43:25.991390407 +0000 UTC m=+21.849622764" watchObservedRunningTime="2026-09-14 09:43:25.992039284 +0000 UTC m=+21.850271641"
Sep 14 09:43:26.038062 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:26.037044    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-grhmb" podStartSLOduration=3.145485042 podStartE2EDuration="22.037022883s" totalImagesPullingTime="18.891537841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:43:26.036665671 +0000 UTC m=+21.894898050" watchObservedRunningTime="2026-09-14 09:43:26.037022883 +0000 UTC m=+21.895255240"
Sep 14 09:43:26.100650 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:26.100621    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pnznq"
Sep 14 09:43:26.101805 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:26.101164    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pnznq"
Sep 14 09:43:26.537116 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:26.537095    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 14 09:43:26.619593 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:26.619464    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-14T09:43:26.537111352Z","UUID":"daf23238-a9b0-437a-94f4-b73454389d50","Handler":null,"Name":"","Endpoint":""}
Sep 14 09:43:26.621543 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:26.621521    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 14 09:43:26.621543 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:26.621550    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 14 09:43:26.846030 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:26.845986    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t" event={"ID":"00d21667-eb67-4fd8-bdaa-7f2935e6e131","Type":"ContainerStarted","Data":"cb786b552e35e418287ac269096bb1f300f8c1b6f0685df4ebdf73a744f91123"}
Sep 14 09:43:26.846924 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:26.846090    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t" event={"ID":"00d21667-eb67-4fd8-bdaa-7f2935e6e131","Type":"ContainerStarted","Data":"f2fae9a3d2a512318b44b1635cf418eaacab3fc6911dc46098e794d97e04a151"}
Sep 14 09:43:26.846924 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:26.846146    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t" event={"ID":"00d21667-eb67-4fd8-bdaa-7f2935e6e131","Type":"ContainerStarted","Data":"13e43ba0a31fffb1ca272ed8c3e31d502215a896c5a38b066d07227389110a28"}
Sep 14 09:43:26.846924 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:26.846200    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t" event={"ID":"00d21667-eb67-4fd8-bdaa-7f2935e6e131","Type":"ContainerStarted","Data":"88fbfdf0da887293a9e0d554d830dbe528564502124f2977708732c21b1af14a"}
Sep 14 09:43:26.847830 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:26.847801    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bsbms" event={"ID":"4ba40a4a-c919-4386-97eb-392cad6cf6d1","Type":"ContainerStarted","Data":"69f346c93593f2aa465d71e04185aa4eeeab075598a6016be804ea99997eaabc"}
Sep 14 09:43:26.849905 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:26.849879    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-247.ec2.internal" event={"ID":"f6a8db1d929676593bd9a89c05273daf","Type":"ContainerStarted","Data":"73a8f1550dad8451e26709e048a9910035dcfe8d63b5fde8622bb67b769cf59f"}
Sep 14 09:43:26.852068 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:26.852033    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg" event={"ID":"e46b7233-8686-456c-9d0b-fad99d708742","Type":"ContainerStarted","Data":"feb8775032a6235ea9726b3c5602e116ec304a58115d5a5da197949b01138315"}
Sep 14 09:43:26.852686 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:26.852666    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pnznq"
Sep 14 09:43:26.853178 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:26.853163    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pnznq"
Sep 14 09:43:26.874487 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:26.874428    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bsbms" podStartSLOduration=4.152821825 podStartE2EDuration="22.874404744s" totalImagesPullingTime="18.721582919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:43:26.874269323 +0000 UTC m=+22.732501679" watchObservedRunningTime="2026-09-14 09:43:26.874404744 +0000 UTC m=+22.732637101"
Sep 14 09:43:27.649772 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:27.649677    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:27.649772 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:27.649703    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:27.649772 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:27.649728    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:27.650035 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:27.649831    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rsn7" podUID="684f63fb-ee2f-41ac-a26b-759fa9c2d043"
Sep 14 09:43:27.650035 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:27.649908    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlcmj" podUID="930e6273-c402-447a-ade0-f00b6248df0d"
Sep 14 09:43:27.650035 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:27.649979    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfwwn" podUID="988fb8db-aad4-41fb-b072-6441acaf7135"
Sep 14 09:43:27.857034 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:27.856999    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg" event={"ID":"e46b7233-8686-456c-9d0b-fad99d708742","Type":"ContainerStarted","Data":"8f0f06589a1d96d13076a20d332b22e341f0d9a1096d114048972e530a6d3df2"}
Sep 14 09:43:27.887335 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:27.887277    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-247.ec2.internal" podStartSLOduration=22.887250918 podStartE2EDuration="22.887250918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:43:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:43:26.924606086 +0000 UTC m=+22.782838441" watchObservedRunningTime="2026-09-14 09:43:27.887250918 +0000 UTC m=+23.745483276"
Sep 14 09:43:27.887521 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:27.887446    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnwtg" podStartSLOduration=3.536084808 podStartE2EDuration="23.887438648s" totalImagesPullingTime="20.35135384s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:43:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:43:27.887235615 +0000 UTC m=+23.745467970" watchObservedRunningTime="2026-09-14 09:43:27.887438648 +0000 UTC m=+23.745671005"
Sep 14 09:43:28.863768 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:28.863530    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t" event={"ID":"00d21667-eb67-4fd8-bdaa-7f2935e6e131","Type":"ContainerStarted","Data":"4156a93c8f142c968052bae701f6c5baab4bde841f25d9c6bf5dbb9e770b9f28"}
Sep 14 09:43:29.649429 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:29.649398    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:29.649662 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:29.649403    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:29.649662 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:29.649518    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rsn7" podUID="684f63fb-ee2f-41ac-a26b-759fa9c2d043"
Sep 14 09:43:29.649662 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:29.649403    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:29.649662 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:29.649627    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlcmj" podUID="930e6273-c402-447a-ade0-f00b6248df0d"
Sep 14 09:43:29.649876 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:29.649697    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfwwn" podUID="988fb8db-aad4-41fb-b072-6441acaf7135"
Sep 14 09:43:30.871294 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:30.871256    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t" event={"ID":"00d21667-eb67-4fd8-bdaa-7f2935e6e131","Type":"ContainerStarted","Data":"c11853df87e93de52ba038df992821dcb476f2097913721ac33af3a90248bca7"}
Sep 14 09:43:30.871833 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:30.871549    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:30.871833 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:30.871610    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:30.871833 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:30.871660    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:30.873444 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:30.873416    2581 generic.go:356] "Generic (PLEG): container finished" podID="016118b7-1766-41e1-9d3a-2ae2cc9c187c" containerID="9f857e29563458316a14826552653bf0caf5d56cfd7746ebb4583ac97013d6b2" exitCode=0
Sep 14 09:43:30.873550 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:30.873465    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xhxq" event={"ID":"016118b7-1766-41e1-9d3a-2ae2cc9c187c","Type":"ContainerDied","Data":"9f857e29563458316a14826552653bf0caf5d56cfd7746ebb4583ac97013d6b2"}
Sep 14 09:43:30.887596 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:30.887576    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:30.890137 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:30.890115    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:43:30.908420 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:30.908252    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t" podStartSLOduration=7.453620459 podStartE2EDuration="26.908238645s" totalImagesPullingTime="19.454618186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:43:30.907563095 +0000 UTC m=+26.765795454" watchObservedRunningTime="2026-09-14 09:43:30.908238645 +0000 UTC m=+26.766471000"
Sep 14 09:43:31.650099 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:31.650058    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:31.650099 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:31.650097    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:31.650316 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:31.650097    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:31.650316 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:31.650189    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rsn7" podUID="684f63fb-ee2f-41ac-a26b-759fa9c2d043"
Sep 14 09:43:31.650316 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:31.650248    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfwwn" podUID="988fb8db-aad4-41fb-b072-6441acaf7135"
Sep 14 09:43:31.650445 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:31.650364    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlcmj" podUID="930e6273-c402-447a-ade0-f00b6248df0d"
Sep 14 09:43:31.878390 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:31.878356    2581 generic.go:356] "Generic (PLEG): container finished" podID="016118b7-1766-41e1-9d3a-2ae2cc9c187c" containerID="d11bd6a95a0bfb08c79137140e10214657b3f8a09e84986f7bf107d8feec3549" exitCode=0
Sep 14 09:43:31.878964 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:31.878439    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xhxq" event={"ID":"016118b7-1766-41e1-9d3a-2ae2cc9c187c","Type":"ContainerDied","Data":"d11bd6a95a0bfb08c79137140e10214657b3f8a09e84986f7bf107d8feec3549"}
Sep 14 09:43:32.448851 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:32.448817    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4rsn7"]
Sep 14 09:43:32.449034 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:32.448911    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:32.449034 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:32.448988    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rsn7" podUID="684f63fb-ee2f-41ac-a26b-759fa9c2d043"
Sep 14 09:43:32.462260 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:32.460907    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rfwwn"]
Sep 14 09:43:32.462260 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:32.461090    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:32.462260 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:32.461256    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfwwn" podUID="988fb8db-aad4-41fb-b072-6441acaf7135"
Sep 14 09:43:32.464491 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:32.464463    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wlcmj"]
Sep 14 09:43:32.464625 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:32.464584    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:32.464724 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:32.464687    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlcmj" podUID="930e6273-c402-447a-ade0-f00b6248df0d"
Sep 14 09:43:32.883399 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:32.883311    2581 generic.go:356] "Generic (PLEG): container finished" podID="016118b7-1766-41e1-9d3a-2ae2cc9c187c" containerID="bce7f0b11fef87bf08047df1390ce558e315e84effc7a098451c63e18e4a9e9f" exitCode=0
Sep 14 09:43:32.884045 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:32.883401    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xhxq" event={"ID":"016118b7-1766-41e1-9d3a-2ae2cc9c187c","Type":"ContainerDied","Data":"bce7f0b11fef87bf08047df1390ce558e315e84effc7a098451c63e18e4a9e9f"}
Sep 14 09:43:33.650024 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:33.649984    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:33.650216 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:33.650103    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfwwn" podUID="988fb8db-aad4-41fb-b072-6441acaf7135"
Sep 14 09:43:33.650216 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:33.650164    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:33.650322 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:33.650293    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlcmj" podUID="930e6273-c402-447a-ade0-f00b6248df0d"
Sep 14 09:43:34.651068 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:34.650838    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:34.651453 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:34.651102    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rsn7" podUID="684f63fb-ee2f-41ac-a26b-759fa9c2d043"
Sep 14 09:43:35.649468 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:35.649432    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:35.649704 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:35.649479    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:35.649704 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:35.649552    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfwwn" podUID="988fb8db-aad4-41fb-b072-6441acaf7135"
Sep 14 09:43:35.649704 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:35.649687    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlcmj" podUID="930e6273-c402-447a-ade0-f00b6248df0d"
Sep 14 09:43:36.650206 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:36.650105    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:36.650620 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:36.650252    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rsn7" podUID="684f63fb-ee2f-41ac-a26b-759fa9c2d043"
Sep 14 09:43:37.317061 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:37.317017    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs\") pod \"network-metrics-daemon-wlcmj\" (UID: \"930e6273-c402-447a-ade0-f00b6248df0d\") " pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:37.317228 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:37.317169    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 09:43:37.317268 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:37.317241    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs podName:930e6273-c402-447a-ade0-f00b6248df0d nodeName:}" failed. No retries permitted until 2026-09-14 09:44:09.317224725 +0000 UTC m=+65.175457060 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs") pod "network-metrics-daemon-wlcmj" (UID: "930e6273-c402-447a-ade0-f00b6248df0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 14 09:43:37.417880 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:37.417799    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret\") pod \"global-pull-secret-syncer-4rsn7\" (UID: \"684f63fb-ee2f-41ac-a26b-759fa9c2d043\") " pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:37.418062 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:37.417921    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 14 09:43:37.418062 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:37.417977    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret podName:684f63fb-ee2f-41ac-a26b-759fa9c2d043 nodeName:}" failed. No retries permitted until 2026-09-14 09:44:09.417960038 +0000 UTC m=+65.276192380 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret") pod "global-pull-secret-syncer-4rsn7" (UID: "684f63fb-ee2f-41ac-a26b-759fa9c2d043") : object "kube-system"/"original-pull-secret" not registered
Sep 14 09:43:37.518665 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:37.518632    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9864x\" (UniqueName: \"kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x\") pod \"network-check-target-rfwwn\" (UID: \"988fb8db-aad4-41fb-b072-6441acaf7135\") " pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:37.518828 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:37.518805    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 14 09:43:37.518828 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:37.518826    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 14 09:43:37.518916 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:37.518836    2581 projected.go:196] Error preparing data for projected volume kube-api-access-9864x for pod openshift-network-diagnostics/network-check-target-rfwwn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 09:43:37.518916 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:37.518885    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x podName:988fb8db-aad4-41fb-b072-6441acaf7135 nodeName:}" failed. No retries permitted until 2026-09-14 09:44:09.51887223 +0000 UTC m=+65.377104565 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9864x" (UniqueName: "kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x") pod "network-check-target-rfwwn" (UID: "988fb8db-aad4-41fb-b072-6441acaf7135") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 14 09:43:37.649621 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:37.649597    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:37.649745 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:37.649597    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:37.649745 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:37.649704    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rfwwn" podUID="988fb8db-aad4-41fb-b072-6441acaf7135"
Sep 14 09:43:37.649828 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:37.649799    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wlcmj" podUID="930e6273-c402-447a-ade0-f00b6248df0d"
Sep 14 09:43:37.897447 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:37.897415    2581 generic.go:356] "Generic (PLEG): container finished" podID="016118b7-1766-41e1-9d3a-2ae2cc9c187c" containerID="a7e7c64d0857cfd64a8c3494c79ed7a11e8aef64b4799da1c0965fd4d54a0ed5" exitCode=0
Sep 14 09:43:37.897824 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:37.897475    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xhxq" event={"ID":"016118b7-1766-41e1-9d3a-2ae2cc9c187c","Type":"ContainerDied","Data":"a7e7c64d0857cfd64a8c3494c79ed7a11e8aef64b4799da1c0965fd4d54a0ed5"}
Sep 14 09:43:38.650404 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:38.650312    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:38.650613 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:38.650429    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rsn7" podUID="684f63fb-ee2f-41ac-a26b-759fa9c2d043"
Sep 14 09:43:38.902162 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:38.902084    2581 generic.go:356] "Generic (PLEG): container finished" podID="016118b7-1766-41e1-9d3a-2ae2cc9c187c" containerID="49af1ced33bcc10dec0bc34edbad5924a893c633d1cc24b500b91ee0d0bef3de" exitCode=0
Sep 14 09:43:38.902162 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:38.902144    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xhxq" event={"ID":"016118b7-1766-41e1-9d3a-2ae2cc9c187c","Type":"ContainerDied","Data":"49af1ced33bcc10dec0bc34edbad5924a893c633d1cc24b500b91ee0d0bef3de"}
Sep 14 09:43:38.909820 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:38.909799    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-247.ec2.internal" event="NodeReady"
Sep 14 09:43:38.909923 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:38.909914    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 14 09:43:39.032958 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.032924    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6zmdn"]
Sep 14 09:43:39.047344 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.047321    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rblrn"]
Sep 14 09:43:39.047445 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.047426    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:43:39.053566 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.053529    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hwxbr\""
Sep 14 09:43:39.053851 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.053834    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 14 09:43:39.054034 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.054004    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 14 09:43:39.071432 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.071387    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rblrn"
Sep 14 09:43:39.077882 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.077845    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rblrn"]
Sep 14 09:43:39.078606 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.078585    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6zmdn"]
Sep 14 09:43:39.089582 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.089558    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 14 09:43:39.089832 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.089817    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 14 09:43:39.089883 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.089823    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wswml\""
Sep 14 09:43:39.090582 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.090569    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 14 09:43:39.128910 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.128878    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtxgc\" (UniqueName: \"kubernetes.io/projected/59ba9674-e083-4b6a-b47b-8bf88d0f926c-kube-api-access-rtxgc\") pod \"dns-default-6zmdn\" (UID: \"59ba9674-e083-4b6a-b47b-8bf88d0f926c\") " pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:43:39.128910 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.128911    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59ba9674-e083-4b6a-b47b-8bf88d0f926c-tmp-dir\") pod \"dns-default-6zmdn\" (UID: \"59ba9674-e083-4b6a-b47b-8bf88d0f926c\") " pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:43:39.129109 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.128934    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/59ba9674-e083-4b6a-b47b-8bf88d0f926c-config-volume\") pod \"dns-default-6zmdn\" (UID: \"59ba9674-e083-4b6a-b47b-8bf88d0f926c\") " pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:43:39.129109 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.128948    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls\") pod \"dns-default-6zmdn\" (UID: \"59ba9674-e083-4b6a-b47b-8bf88d0f926c\") " pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:43:39.230115 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.230078    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swgpv\" (UniqueName: \"kubernetes.io/projected/bb79a7dc-bd40-4f24-b163-973dc14c0cb4-kube-api-access-swgpv\") pod \"ingress-canary-rblrn\" (UID: \"bb79a7dc-bd40-4f24-b163-973dc14c0cb4\") " pod="openshift-ingress-canary/ingress-canary-rblrn"
Sep 14 09:43:39.230302 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.230119    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb79a7dc-bd40-4f24-b163-973dc14c0cb4-cert\") pod \"ingress-canary-rblrn\" (UID: \"bb79a7dc-bd40-4f24-b163-973dc14c0cb4\") " pod="openshift-ingress-canary/ingress-canary-rblrn"
Sep 14 09:43:39.230302 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.230159    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtxgc\" (UniqueName: \"kubernetes.io/projected/59ba9674-e083-4b6a-b47b-8bf88d0f926c-kube-api-access-rtxgc\") pod \"dns-default-6zmdn\" (UID: \"59ba9674-e083-4b6a-b47b-8bf88d0f926c\") " pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:43:39.230302 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.230186    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59ba9674-e083-4b6a-b47b-8bf88d0f926c-tmp-dir\") pod \"dns-default-6zmdn\" (UID: \"59ba9674-e083-4b6a-b47b-8bf88d0f926c\") " pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:43:39.230302 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.230215    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/59ba9674-e083-4b6a-b47b-8bf88d0f926c-config-volume\") pod \"dns-default-6zmdn\" (UID: \"59ba9674-e083-4b6a-b47b-8bf88d0f926c\") " pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:43:39.230302 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.230238    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls\") pod \"dns-default-6zmdn\" (UID: \"59ba9674-e083-4b6a-b47b-8bf88d0f926c\") " pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:43:39.230479 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:39.230422    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 09:43:39.230511 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:39.230494    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls podName:59ba9674-e083-4b6a-b47b-8bf88d0f926c nodeName:}" failed. No retries permitted until 2026-09-14 09:43:39.730464901 +0000 UTC m=+35.588697235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls") pod "dns-default-6zmdn" (UID: "59ba9674-e083-4b6a-b47b-8bf88d0f926c") : secret "dns-default-metrics-tls" not found
Sep 14 09:43:39.230586 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.230565    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59ba9674-e083-4b6a-b47b-8bf88d0f926c-tmp-dir\") pod \"dns-default-6zmdn\" (UID: \"59ba9674-e083-4b6a-b47b-8bf88d0f926c\") " pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:43:39.230818 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.230801    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/59ba9674-e083-4b6a-b47b-8bf88d0f926c-config-volume\") pod \"dns-default-6zmdn\" (UID: \"59ba9674-e083-4b6a-b47b-8bf88d0f926c\") " pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:43:39.258247 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.258115    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtxgc\" (UniqueName: \"kubernetes.io/projected/59ba9674-e083-4b6a-b47b-8bf88d0f926c-kube-api-access-rtxgc\") pod \"dns-default-6zmdn\" (UID: \"59ba9674-e083-4b6a-b47b-8bf88d0f926c\") " pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:43:39.331213 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.331173    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swgpv\" (UniqueName: \"kubernetes.io/projected/bb79a7dc-bd40-4f24-b163-973dc14c0cb4-kube-api-access-swgpv\") pod \"ingress-canary-rblrn\" (UID: \"bb79a7dc-bd40-4f24-b163-973dc14c0cb4\") " pod="openshift-ingress-canary/ingress-canary-rblrn"
Sep 14 09:43:39.331213 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.331212    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb79a7dc-bd40-4f24-b163-973dc14c0cb4-cert\") pod \"ingress-canary-rblrn\" (UID: \"bb79a7dc-bd40-4f24-b163-973dc14c0cb4\") " pod="openshift-ingress-canary/ingress-canary-rblrn"
Sep 14 09:43:39.333838 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.333814    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb79a7dc-bd40-4f24-b163-973dc14c0cb4-cert\") pod \"ingress-canary-rblrn\" (UID: \"bb79a7dc-bd40-4f24-b163-973dc14c0cb4\") " pod="openshift-ingress-canary/ingress-canary-rblrn"
Sep 14 09:43:39.343100 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.343065    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swgpv\" (UniqueName: \"kubernetes.io/projected/bb79a7dc-bd40-4f24-b163-973dc14c0cb4-kube-api-access-swgpv\") pod \"ingress-canary-rblrn\" (UID: \"bb79a7dc-bd40-4f24-b163-973dc14c0cb4\") " pod="openshift-ingress-canary/ingress-canary-rblrn"
Sep 14 09:43:39.381162 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.381122    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rblrn"
Sep 14 09:43:39.649930 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.649885    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:43:39.649930 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.649916    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:43:39.677179 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.677149    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9ctbn\""
Sep 14 09:43:39.677366 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.677243    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 14 09:43:39.677496 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.677480    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 14 09:43:39.677543 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.677509    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-clrv6\""
Sep 14 09:43:39.684218 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.684198    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 14 09:43:39.734682 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.734588    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls\") pod \"dns-default-6zmdn\" (UID: \"59ba9674-e083-4b6a-b47b-8bf88d0f926c\") " pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:43:39.734858 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:39.734760    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 09:43:39.734858 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:39.734824    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls podName:59ba9674-e083-4b6a-b47b-8bf88d0f926c nodeName:}" failed. No retries permitted until 2026-09-14 09:43:40.734808585 +0000 UTC m=+36.593040918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls") pod "dns-default-6zmdn" (UID: "59ba9674-e083-4b6a-b47b-8bf88d0f926c") : secret "dns-default-metrics-tls" not found
Sep 14 09:43:39.794091 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.794052    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rblrn"]
Sep 14 09:43:39.799364 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:43:39.799336    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb79a7dc_bd40_4f24_b163_973dc14c0cb4.slice/crio-dd310b0deeab02522bafc56541d2e8c679dc1740043b09fae80999cb74237d91 WatchSource:0}: Error finding container dd310b0deeab02522bafc56541d2e8c679dc1740043b09fae80999cb74237d91: Status 404 returned error can't find the container with id dd310b0deeab02522bafc56541d2e8c679dc1740043b09fae80999cb74237d91
Sep 14 09:43:39.905672 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.905636    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rblrn" event={"ID":"bb79a7dc-bd40-4f24-b163-973dc14c0cb4","Type":"ContainerStarted","Data":"dd310b0deeab02522bafc56541d2e8c679dc1740043b09fae80999cb74237d91"}
Sep 14 09:43:39.909073 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:39.909040    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xhxq" event={"ID":"016118b7-1766-41e1-9d3a-2ae2cc9c187c","Type":"ContainerStarted","Data":"7cbf4cdcad7b94d206c7796f28b3caf7ae624f41b9609d132fca8595a62ec18a"}
Sep 14 09:43:40.649703 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:40.649667    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:43:40.654530 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:40.654500    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 14 09:43:40.742614 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:40.742563    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls\") pod \"dns-default-6zmdn\" (UID: \"59ba9674-e083-4b6a-b47b-8bf88d0f926c\") " pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:43:40.742802 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:40.742740    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 09:43:40.742855 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:40.742805    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls podName:59ba9674-e083-4b6a-b47b-8bf88d0f926c nodeName:}" failed. No retries permitted until 2026-09-14 09:43:42.742789318 +0000 UTC m=+38.601021653 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls") pod "dns-default-6zmdn" (UID: "59ba9674-e083-4b6a-b47b-8bf88d0f926c") : secret "dns-default-metrics-tls" not found
Sep 14 09:43:42.759014 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:42.758975    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls\") pod \"dns-default-6zmdn\" (UID: \"59ba9674-e083-4b6a-b47b-8bf88d0f926c\") " pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:43:42.759468 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:42.759087    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 09:43:42.759468 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:42.759144    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls podName:59ba9674-e083-4b6a-b47b-8bf88d0f926c nodeName:}" failed. No retries permitted until 2026-09-14 09:43:46.759131781 +0000 UTC m=+42.617364119 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls") pod "dns-default-6zmdn" (UID: "59ba9674-e083-4b6a-b47b-8bf88d0f926c") : secret "dns-default-metrics-tls" not found
Sep 14 09:43:42.917816 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:42.917779    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rblrn" event={"ID":"bb79a7dc-bd40-4f24-b163-973dc14c0cb4","Type":"ContainerStarted","Data":"c8e82ddedad52755cf8f31b1f6b0f4b90e6195f4b818712dd59ca6a991f60a2b"}
Sep 14 09:43:42.940177 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:42.940109    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8xhxq" podStartSLOduration=10.209611963 podStartE2EDuration="38.940093883s" totalImagesPullingTime="28.73048192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:43:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:43:39.949202959 +0000 UTC m=+35.807435314" watchObservedRunningTime="2026-09-14 09:43:42.940093883 +0000 UTC m=+38.798326238"
Sep 14 09:43:42.940533 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:42.940458    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rblrn" podStartSLOduration=2.694118838 podStartE2EDuration="4.940447407s" totalImagesPullingTime="2.246328569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:43:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:43:42.939319569 +0000 UTC m=+38.797551926" watchObservedRunningTime="2026-09-14 09:43:42.940447407 +0000 UTC m=+38.798679779"
Sep 14 09:43:46.791700 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:46.791654    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls\") pod \"dns-default-6zmdn\" (UID: \"59ba9674-e083-4b6a-b47b-8bf88d0f926c\") " pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:43:46.792104 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:46.791818    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 09:43:46.792104 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:46.791886    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls podName:59ba9674-e083-4b6a-b47b-8bf88d0f926c nodeName:}" failed. No retries permitted until 2026-09-14 09:43:54.791870475 +0000 UTC m=+50.650102810 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls") pod "dns-default-6zmdn" (UID: "59ba9674-e083-4b6a-b47b-8bf88d0f926c") : secret "dns-default-metrics-tls" not found
Sep 14 09:43:54.847379 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:43:54.847334    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls\") pod \"dns-default-6zmdn\" (UID: \"59ba9674-e083-4b6a-b47b-8bf88d0f926c\") " pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:43:54.847863 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:54.847446    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 09:43:54.847863 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:43:54.847499    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls podName:59ba9674-e083-4b6a-b47b-8bf88d0f926c nodeName:}" failed. No retries permitted until 2026-09-14 09:44:10.847485483 +0000 UTC m=+66.705717821 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls") pod "dns-default-6zmdn" (UID: "59ba9674-e083-4b6a-b47b-8bf88d0f926c") : secret "dns-default-metrics-tls" not found
Sep 14 09:44:02.893758 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:02.893725    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmq8t"
Sep 14 09:44:09.347686 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:09.347643    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs\") pod \"network-metrics-daemon-wlcmj\" (UID: \"930e6273-c402-447a-ade0-f00b6248df0d\") " pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:44:09.351764 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:09.351743    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 14 09:44:09.358610 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:09.358578    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 14 09:44:09.358684 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:09.358645    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs podName:930e6273-c402-447a-ade0-f00b6248df0d nodeName:}" failed. No retries permitted until 2026-09-14 09:45:13.358629345 +0000 UTC m=+129.216861679 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs") pod "network-metrics-daemon-wlcmj" (UID: "930e6273-c402-447a-ade0-f00b6248df0d") : secret "metrics-daemon-secret" not found
Sep 14 09:44:09.448701 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:09.448660    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret\") pod \"global-pull-secret-syncer-4rsn7\" (UID: \"684f63fb-ee2f-41ac-a26b-759fa9c2d043\") " pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:44:09.451956 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:09.451936    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 14 09:44:09.462438 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:09.462419    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/684f63fb-ee2f-41ac-a26b-759fa9c2d043-original-pull-secret\") pod \"global-pull-secret-syncer-4rsn7\" (UID: \"684f63fb-ee2f-41ac-a26b-759fa9c2d043\") " pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:44:09.549211 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:09.549172    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9864x\" (UniqueName: \"kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x\") pod \"network-check-target-rfwwn\" (UID: \"988fb8db-aad4-41fb-b072-6441acaf7135\") " pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:44:09.552313 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:09.552294    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 14 09:44:09.562961 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:09.562940    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 14 09:44:09.572760 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:09.572738    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9864x\" (UniqueName: \"kubernetes.io/projected/988fb8db-aad4-41fb-b072-6441acaf7135-kube-api-access-9864x\") pod \"network-check-target-rfwwn\" (UID: \"988fb8db-aad4-41fb-b072-6441acaf7135\") " pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:44:09.668324 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:09.668241    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-clrv6\""
Sep 14 09:44:09.676181 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:09.676159    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:44:09.760169 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:09.760145    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rsn7"
Sep 14 09:44:09.988541 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:09.988495    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rfwwn"]
Sep 14 09:44:09.991115 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:44:09.991084    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod988fb8db_aad4_41fb_b072_6441acaf7135.slice/crio-9277f77002603c20288ca8613ca494b17e3bd6c9a456f4b1a600ac2cb596dd20 WatchSource:0}: Error finding container 9277f77002603c20288ca8613ca494b17e3bd6c9a456f4b1a600ac2cb596dd20: Status 404 returned error can't find the container with id 9277f77002603c20288ca8613ca494b17e3bd6c9a456f4b1a600ac2cb596dd20
Sep 14 09:44:10.058557 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:10.058523    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4rsn7"]
Sep 14 09:44:10.061873 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:44:10.061844    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod684f63fb_ee2f_41ac_a26b_759fa9c2d043.slice/crio-425e8f7dba870c4d9c1e85053756cb25327b76e91401ce347ab60d9f122cfd8b WatchSource:0}: Error finding container 425e8f7dba870c4d9c1e85053756cb25327b76e91401ce347ab60d9f122cfd8b: Status 404 returned error can't find the container with id 425e8f7dba870c4d9c1e85053756cb25327b76e91401ce347ab60d9f122cfd8b
Sep 14 09:44:10.858610 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:10.858552    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls\") pod \"dns-default-6zmdn\" (UID: \"59ba9674-e083-4b6a-b47b-8bf88d0f926c\") " pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:44:10.859152 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:10.858700    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 09:44:10.859152 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:10.858809    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls podName:59ba9674-e083-4b6a-b47b-8bf88d0f926c nodeName:}" failed. No retries permitted until 2026-09-14 09:44:42.858788404 +0000 UTC m=+98.717020744 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls") pod "dns-default-6zmdn" (UID: "59ba9674-e083-4b6a-b47b-8bf88d0f926c") : secret "dns-default-metrics-tls" not found
Sep 14 09:44:10.982559 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:10.982516    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4rsn7" event={"ID":"684f63fb-ee2f-41ac-a26b-759fa9c2d043","Type":"ContainerStarted","Data":"425e8f7dba870c4d9c1e85053756cb25327b76e91401ce347ab60d9f122cfd8b"}
Sep 14 09:44:10.983768 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:10.983742    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rfwwn" event={"ID":"988fb8db-aad4-41fb-b072-6441acaf7135","Type":"ContainerStarted","Data":"9277f77002603c20288ca8613ca494b17e3bd6c9a456f4b1a600ac2cb596dd20"}
Sep 14 09:44:14.996852 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:14.996807    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4rsn7" event={"ID":"684f63fb-ee2f-41ac-a26b-759fa9c2d043","Type":"ContainerStarted","Data":"7e99f069b6b9e7a6a5b88114ef648b8def5de11d8843eafce06b7a8a18c82b33"}
Sep 14 09:44:14.998336 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:14.998317    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rfwwn" event={"ID":"988fb8db-aad4-41fb-b072-6441acaf7135","Type":"ContainerStarted","Data":"dffbf55bdc5eafff4a95e2d46cfb0230b53604da194158f180704a8019d05412"}
Sep 14 09:44:14.998446 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:14.998435    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:44:15.018856 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:15.018792    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4rsn7" podStartSLOduration=66.807069302 podStartE2EDuration="1m11.018777973s" totalImagesPullingTime="4.211708671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:44:15.018677028 +0000 UTC m=+70.876909389" watchObservedRunningTime="2026-09-14 09:44:15.018777973 +0000 UTC m=+70.877010330"
Sep 14 09:44:15.044118 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:15.044073    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rfwwn" podStartSLOduration=66.764873631 podStartE2EDuration="1m11.044062766s" totalImagesPullingTime="4.279189135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:44:15.043530461 +0000 UTC m=+70.901762817" watchObservedRunningTime="2026-09-14 09:44:15.044062766 +0000 UTC m=+70.902295136"
Sep 14 09:44:30.994173 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:30.994031    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-lzhmx"]
Sep 14 09:44:30.998368 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:30.998346    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-lzhmx"
Sep 14 09:44:31.006408 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.006388    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fd4tg\""
Sep 14 09:44:31.042670 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.042631    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-858c855598-jhg2x"]
Sep 14 09:44:31.045655 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.045634    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-zst5h"]
Sep 14 09:44:31.045794 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.045768    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:31.048239 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.048222    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-lzhmx"]
Sep 14 09:44:31.048335 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.048293    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-zst5h"
Sep 14 09:44:31.065552 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.065532    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 14 09:44:31.066800 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.066782    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 14 09:44:31.066904 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.066804    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 14 09:44:31.066904 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.066813    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-92vxw\""
Sep 14 09:44:31.067824 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.067810    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 14 09:44:31.067963 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.067947    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 14 09:44:31.068318 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.068304    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 14 09:44:31.080761 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.080743    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 14 09:44:31.080898 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.080881    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 14 09:44:31.080971 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.080955    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 14 09:44:31.081115 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.081098    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 14 09:44:31.081198 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.081184    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7kwjb\""
Sep 14 09:44:31.084009 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.083993    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 14 09:44:31.094164 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.094128    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977c6b7b-d8e8-4b0d-b312-163d6fee715a-trusted-ca-bundle\") pod \"insights-operator-5844b856db-zst5h\" (UID: \"977c6b7b-d8e8-4b0d-b312-163d6fee715a\") " pod="openshift-insights/insights-operator-5844b856db-zst5h"
Sep 14 09:44:31.094225 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.094172    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-service-ca-bundle\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:31.094264 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.094242    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gt27\" (UniqueName: \"kubernetes.io/projected/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-kube-api-access-9gt27\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:31.094303 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.094267    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/977c6b7b-d8e8-4b0d-b312-163d6fee715a-serving-cert\") pod \"insights-operator-5844b856db-zst5h\" (UID: \"977c6b7b-d8e8-4b0d-b312-163d6fee715a\") " pod="openshift-insights/insights-operator-5844b856db-zst5h"
Sep 14 09:44:31.094303 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.094286    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r456\" (UniqueName: \"kubernetes.io/projected/051ee978-432c-44be-9022-974b80c53783-kube-api-access-7r456\") pod \"network-check-source-6f8b768455-lzhmx\" (UID: \"051ee978-432c-44be-9022-974b80c53783\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-lzhmx"
Sep 14 09:44:31.094386 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.094309    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/977c6b7b-d8e8-4b0d-b312-163d6fee715a-tmp\") pod \"insights-operator-5844b856db-zst5h\" (UID: \"977c6b7b-d8e8-4b0d-b312-163d6fee715a\") " pod="openshift-insights/insights-operator-5844b856db-zst5h"
Sep 14 09:44:31.094386 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.094327    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977c6b7b-d8e8-4b0d-b312-163d6fee715a-service-ca-bundle\") pod \"insights-operator-5844b856db-zst5h\" (UID: \"977c6b7b-d8e8-4b0d-b312-163d6fee715a\") " pod="openshift-insights/insights-operator-5844b856db-zst5h"
Sep 14 09:44:31.094386 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.094342    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j86jv\" (UniqueName: \"kubernetes.io/projected/977c6b7b-d8e8-4b0d-b312-163d6fee715a-kube-api-access-j86jv\") pod \"insights-operator-5844b856db-zst5h\" (UID: \"977c6b7b-d8e8-4b0d-b312-163d6fee715a\") " pod="openshift-insights/insights-operator-5844b856db-zst5h"
Sep 14 09:44:31.094481 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.094421    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-default-certificate\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:31.094481 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.094446    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-stats-auth\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:31.094481 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.094461    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-metrics-certs\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:31.094481 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.094476    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/977c6b7b-d8e8-4b0d-b312-163d6fee715a-snapshots\") pod \"insights-operator-5844b856db-zst5h\" (UID: \"977c6b7b-d8e8-4b0d-b312-163d6fee715a\") " pod="openshift-insights/insights-operator-5844b856db-zst5h"
Sep 14 09:44:31.184448 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.184416    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-zst5h"]
Sep 14 09:44:31.186104 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.186075    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-858c855598-jhg2x"]
Sep 14 09:44:31.195333 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.195305    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977c6b7b-d8e8-4b0d-b312-163d6fee715a-trusted-ca-bundle\") pod \"insights-operator-5844b856db-zst5h\" (UID: \"977c6b7b-d8e8-4b0d-b312-163d6fee715a\") " pod="openshift-insights/insights-operator-5844b856db-zst5h"
Sep 14 09:44:31.195493 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.195346    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-service-ca-bundle\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:31.195493 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.195421    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gt27\" (UniqueName: \"kubernetes.io/projected/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-kube-api-access-9gt27\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:31.195493 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.195450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/977c6b7b-d8e8-4b0d-b312-163d6fee715a-serving-cert\") pod \"insights-operator-5844b856db-zst5h\" (UID: \"977c6b7b-d8e8-4b0d-b312-163d6fee715a\") " pod="openshift-insights/insights-operator-5844b856db-zst5h"
Sep 14 09:44:31.195493 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.195471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r456\" (UniqueName: \"kubernetes.io/projected/051ee978-432c-44be-9022-974b80c53783-kube-api-access-7r456\") pod \"network-check-source-6f8b768455-lzhmx\" (UID: \"051ee978-432c-44be-9022-974b80c53783\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-lzhmx"
Sep 14 09:44:31.195702 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.195500    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/977c6b7b-d8e8-4b0d-b312-163d6fee715a-tmp\") pod \"insights-operator-5844b856db-zst5h\" (UID: \"977c6b7b-d8e8-4b0d-b312-163d6fee715a\") " pod="openshift-insights/insights-operator-5844b856db-zst5h"
Sep 14 09:44:31.195702 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.195523    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977c6b7b-d8e8-4b0d-b312-163d6fee715a-service-ca-bundle\") pod \"insights-operator-5844b856db-zst5h\" (UID: \"977c6b7b-d8e8-4b0d-b312-163d6fee715a\") " pod="openshift-insights/insights-operator-5844b856db-zst5h"
Sep 14 09:44:31.195702 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.195547    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j86jv\" (UniqueName: \"kubernetes.io/projected/977c6b7b-d8e8-4b0d-b312-163d6fee715a-kube-api-access-j86jv\") pod \"insights-operator-5844b856db-zst5h\" (UID: \"977c6b7b-d8e8-4b0d-b312-163d6fee715a\") " pod="openshift-insights/insights-operator-5844b856db-zst5h"
Sep 14 09:44:31.195877 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.195726    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-default-certificate\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:31.195877 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.195763    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-stats-auth\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:31.195877 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.195791    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-metrics-certs\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:31.195877 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.195817    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/977c6b7b-d8e8-4b0d-b312-163d6fee715a-snapshots\") pod \"insights-operator-5844b856db-zst5h\" (UID: \"977c6b7b-d8e8-4b0d-b312-163d6fee715a\") " pod="openshift-insights/insights-operator-5844b856db-zst5h"
Sep 14 09:44:31.196072 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.195998    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/977c6b7b-d8e8-4b0d-b312-163d6fee715a-tmp\") pod \"insights-operator-5844b856db-zst5h\" (UID: \"977c6b7b-d8e8-4b0d-b312-163d6fee715a\") " pod="openshift-insights/insights-operator-5844b856db-zst5h"
Sep 14 09:44:31.196125 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.196069    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977c6b7b-d8e8-4b0d-b312-163d6fee715a-service-ca-bundle\") pod \"insights-operator-5844b856db-zst5h\" (UID: \"977c6b7b-d8e8-4b0d-b312-163d6fee715a\") " pod="openshift-insights/insights-operator-5844b856db-zst5h"
Sep 14 09:44:31.196125 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:31.196100    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 09:44:31.196233 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:31.196163    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-metrics-certs podName:ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd nodeName:}" failed. No retries permitted until 2026-09-14 09:44:31.696145736 +0000 UTC m=+87.554378069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-metrics-certs") pod "router-default-858c855598-jhg2x" (UID: "ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd") : secret "router-metrics-certs-default" not found
Sep 14 09:44:31.196233 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:31.196186    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-service-ca-bundle podName:ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd nodeName:}" failed. No retries permitted until 2026-09-14 09:44:31.696171822 +0000 UTC m=+87.554404163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-service-ca-bundle") pod "router-default-858c855598-jhg2x" (UID: "ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd") : configmap references non-existent config key: service-ca.crt
Sep 14 09:44:31.196407 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.196390    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/977c6b7b-d8e8-4b0d-b312-163d6fee715a-trusted-ca-bundle\") pod \"insights-operator-5844b856db-zst5h\" (UID: \"977c6b7b-d8e8-4b0d-b312-163d6fee715a\") " pod="openshift-insights/insights-operator-5844b856db-zst5h"
Sep 14 09:44:31.196477 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.196459    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/977c6b7b-d8e8-4b0d-b312-163d6fee715a-snapshots\") pod \"insights-operator-5844b856db-zst5h\" (UID: \"977c6b7b-d8e8-4b0d-b312-163d6fee715a\") " pod="openshift-insights/insights-operator-5844b856db-zst5h"
Sep 14 09:44:31.198182 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.198160    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-stats-auth\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:31.198380 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.198360    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/977c6b7b-d8e8-4b0d-b312-163d6fee715a-serving-cert\") pod \"insights-operator-5844b856db-zst5h\" (UID: \"977c6b7b-d8e8-4b0d-b312-163d6fee715a\") " pod="openshift-insights/insights-operator-5844b856db-zst5h"
Sep 14 09:44:31.198473 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.198460    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-default-certificate\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:31.237076 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.237041    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gt27\" (UniqueName: \"kubernetes.io/projected/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-kube-api-access-9gt27\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:31.241891 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.241866    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r456\" (UniqueName: \"kubernetes.io/projected/051ee978-432c-44be-9022-974b80c53783-kube-api-access-7r456\") pod \"network-check-source-6f8b768455-lzhmx\" (UID: \"051ee978-432c-44be-9022-974b80c53783\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-lzhmx"
Sep 14 09:44:31.245569 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.245495    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-npw7b"]
Sep 14 09:44:31.249669 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.249647    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-npw7b"
Sep 14 09:44:31.251316 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.251296    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j86jv\" (UniqueName: \"kubernetes.io/projected/977c6b7b-d8e8-4b0d-b312-163d6fee715a-kube-api-access-j86jv\") pod \"insights-operator-5844b856db-zst5h\" (UID: \"977c6b7b-d8e8-4b0d-b312-163d6fee715a\") " pod="openshift-insights/insights-operator-5844b856db-zst5h"
Sep 14 09:44:31.296158 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.296119    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0c1229e7-9521-4b30-a1e3-09db80859a19-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-npw7b\" (UID: \"0c1229e7-9521-4b30-a1e3-09db80859a19\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-npw7b"
Sep 14 09:44:31.296158 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.296163    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c1229e7-9521-4b30-a1e3-09db80859a19-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-npw7b\" (UID: \"0c1229e7-9521-4b30-a1e3-09db80859a19\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-npw7b"
Sep 14 09:44:31.306132 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.306111    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-lzhmx"
Sep 14 09:44:31.307584 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.307558    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 14 09:44:31.308500 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.308479    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wnntw"]
Sep 14 09:44:31.311340 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.311321    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wnntw"
Sep 14 09:44:31.319215 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.319187    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-p7srh\""
Sep 14 09:44:31.319215 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.319187    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 14 09:44:31.319420 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.319338    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-cstfw\""
Sep 14 09:44:31.319875 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.319856    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 14 09:44:31.333426 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.333393    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 14 09:44:31.333614 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.333566    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 14 09:44:31.333693 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.333640    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 14 09:44:31.334457 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.334428    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-npw7b"]
Sep 14 09:44:31.359199 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.358957    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-zst5h"
Sep 14 09:44:31.391523 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.391467    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wnntw"]
Sep 14 09:44:31.397400 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.397369    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bafdd1e7-cf34-4b63-9d55-9f5785b01ea3-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wnntw\" (UID: \"bafdd1e7-cf34-4b63-9d55-9f5785b01ea3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wnntw"
Sep 14 09:44:31.397558 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.397409    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kkbv\" (UniqueName: \"kubernetes.io/projected/bafdd1e7-cf34-4b63-9d55-9f5785b01ea3-kube-api-access-2kkbv\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wnntw\" (UID: \"bafdd1e7-cf34-4b63-9d55-9f5785b01ea3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wnntw"
Sep 14 09:44:31.397558 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.397434    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bafdd1e7-cf34-4b63-9d55-9f5785b01ea3-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wnntw\" (UID: \"bafdd1e7-cf34-4b63-9d55-9f5785b01ea3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wnntw"
Sep 14 09:44:31.397558 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.397488    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0c1229e7-9521-4b30-a1e3-09db80859a19-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-npw7b\" (UID: \"0c1229e7-9521-4b30-a1e3-09db80859a19\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-npw7b"
Sep 14 09:44:31.397558 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.397525    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c1229e7-9521-4b30-a1e3-09db80859a19-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-npw7b\" (UID: \"0c1229e7-9521-4b30-a1e3-09db80859a19\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-npw7b"
Sep 14 09:44:31.397697 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:31.397618    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 14 09:44:31.397697 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:31.397683    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c1229e7-9521-4b30-a1e3-09db80859a19-networking-console-plugin-cert podName:0c1229e7-9521-4b30-a1e3-09db80859a19 nodeName:}" failed. No retries permitted until 2026-09-14 09:44:31.897667487 +0000 UTC m=+87.755899850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0c1229e7-9521-4b30-a1e3-09db80859a19-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-npw7b" (UID: "0c1229e7-9521-4b30-a1e3-09db80859a19") : secret "networking-console-plugin-cert" not found
Sep 14 09:44:31.398177 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.398156    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0c1229e7-9521-4b30-a1e3-09db80859a19-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-npw7b\" (UID: \"0c1229e7-9521-4b30-a1e3-09db80859a19\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-npw7b"
Sep 14 09:44:31.498592 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.498480    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bafdd1e7-cf34-4b63-9d55-9f5785b01ea3-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wnntw\" (UID: \"bafdd1e7-cf34-4b63-9d55-9f5785b01ea3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wnntw"
Sep 14 09:44:31.498592 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.498527    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kkbv\" (UniqueName: \"kubernetes.io/projected/bafdd1e7-cf34-4b63-9d55-9f5785b01ea3-kube-api-access-2kkbv\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wnntw\" (UID: \"bafdd1e7-cf34-4b63-9d55-9f5785b01ea3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wnntw"
Sep 14 09:44:31.498592 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.498559    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bafdd1e7-cf34-4b63-9d55-9f5785b01ea3-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wnntw\" (UID: \"bafdd1e7-cf34-4b63-9d55-9f5785b01ea3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wnntw"
Sep 14 09:44:31.499353 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.499329    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bafdd1e7-cf34-4b63-9d55-9f5785b01ea3-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wnntw\" (UID: \"bafdd1e7-cf34-4b63-9d55-9f5785b01ea3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wnntw"
Sep 14 09:44:31.500836 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.500816    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bafdd1e7-cf34-4b63-9d55-9f5785b01ea3-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wnntw\" (UID: \"bafdd1e7-cf34-4b63-9d55-9f5785b01ea3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wnntw"
Sep 14 09:44:31.522375 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.522354    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kkbv\" (UniqueName: \"kubernetes.io/projected/bafdd1e7-cf34-4b63-9d55-9f5785b01ea3-kube-api-access-2kkbv\") pod \"kube-storage-version-migrator-operator-6c8f84f897-wnntw\" (UID: \"bafdd1e7-cf34-4b63-9d55-9f5785b01ea3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wnntw"
Sep 14 09:44:31.620114 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.620076    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wnntw"
Sep 14 09:44:31.649859 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.649832    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-lzhmx"]
Sep 14 09:44:31.652388 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:44:31.652360    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod051ee978_432c_44be_9022_974b80c53783.slice/crio-ec828319deb082d6409d2f36a453569eb0765b942102e2d63ef666a7c71d8dac WatchSource:0}: Error finding container ec828319deb082d6409d2f36a453569eb0765b942102e2d63ef666a7c71d8dac: Status 404 returned error can't find the container with id ec828319deb082d6409d2f36a453569eb0765b942102e2d63ef666a7c71d8dac
Sep 14 09:44:31.680862 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.680826    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-zst5h"]
Sep 14 09:44:31.697380 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:44:31.697349    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977c6b7b_d8e8_4b0d_b312_163d6fee715a.slice/crio-fa6d89afd0e64a6dc6400af030fb4ca04228f365b9a94f547a5dc1553dad8bb5 WatchSource:0}: Error finding container fa6d89afd0e64a6dc6400af030fb4ca04228f365b9a94f547a5dc1553dad8bb5: Status 404 returned error can't find the container with id fa6d89afd0e64a6dc6400af030fb4ca04228f365b9a94f547a5dc1553dad8bb5
Sep 14 09:44:31.700631 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.700551    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-service-ca-bundle\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:31.700631 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.700617    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-metrics-certs\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:31.700833 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:31.700731    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 09:44:31.700833 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:31.700741    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-service-ca-bundle podName:ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd nodeName:}" failed. No retries permitted until 2026-09-14 09:44:32.700699385 +0000 UTC m=+88.558931723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-service-ca-bundle") pod "router-default-858c855598-jhg2x" (UID: "ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd") : configmap references non-existent config key: service-ca.crt
Sep 14 09:44:31.700833 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:31.700782    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-metrics-certs podName:ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd nodeName:}" failed. No retries permitted until 2026-09-14 09:44:32.70077088 +0000 UTC m=+88.559003214 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-metrics-certs") pod "router-default-858c855598-jhg2x" (UID: "ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd") : secret "router-metrics-certs-default" not found
Sep 14 09:44:31.902544 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.902465    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wnntw"]
Sep 14 09:44:31.902684 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:31.902652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c1229e7-9521-4b30-a1e3-09db80859a19-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-npw7b\" (UID: \"0c1229e7-9521-4b30-a1e3-09db80859a19\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-npw7b"
Sep 14 09:44:31.902831 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:31.902817    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 14 09:44:31.902909 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:31.902895    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c1229e7-9521-4b30-a1e3-09db80859a19-networking-console-plugin-cert podName:0c1229e7-9521-4b30-a1e3-09db80859a19 nodeName:}" failed. No retries permitted until 2026-09-14 09:44:32.902873934 +0000 UTC m=+88.761106273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0c1229e7-9521-4b30-a1e3-09db80859a19-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-npw7b" (UID: "0c1229e7-9521-4b30-a1e3-09db80859a19") : secret "networking-console-plugin-cert" not found
Sep 14 09:44:31.906229 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:44:31.906201    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbafdd1e7_cf34_4b63_9d55_9f5785b01ea3.slice/crio-631ba9999194a83b169bfbc8c8c376728ec4a89139b48f58ba946190cfabf451 WatchSource:0}: Error finding container 631ba9999194a83b169bfbc8c8c376728ec4a89139b48f58ba946190cfabf451: Status 404 returned error can't find the container with id 631ba9999194a83b169bfbc8c8c376728ec4a89139b48f58ba946190cfabf451
Sep 14 09:44:32.041924 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:32.041884    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wnntw" event={"ID":"bafdd1e7-cf34-4b63-9d55-9f5785b01ea3","Type":"ContainerStarted","Data":"631ba9999194a83b169bfbc8c8c376728ec4a89139b48f58ba946190cfabf451"}
Sep 14 09:44:32.043098 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:32.043073    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-zst5h" event={"ID":"977c6b7b-d8e8-4b0d-b312-163d6fee715a","Type":"ContainerStarted","Data":"fa6d89afd0e64a6dc6400af030fb4ca04228f365b9a94f547a5dc1553dad8bb5"}
Sep 14 09:44:32.044578 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:32.044556    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-lzhmx" event={"ID":"051ee978-432c-44be-9022-974b80c53783","Type":"ContainerStarted","Data":"f18aacbef9e1768678bd1c73cce65047b795598bbf43d7f0b8274fe425e63bda"}
Sep 14 09:44:32.044671 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:32.044593    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-lzhmx" event={"ID":"051ee978-432c-44be-9022-974b80c53783","Type":"ContainerStarted","Data":"ec828319deb082d6409d2f36a453569eb0765b942102e2d63ef666a7c71d8dac"}
Sep 14 09:44:32.709808 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:32.709763    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-metrics-certs\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:32.710007 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:32.709857    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-service-ca-bundle\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:32.710007 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:32.709934    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 09:44:32.710128 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:32.710011    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-metrics-certs podName:ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd nodeName:}" failed. No retries permitted until 2026-09-14 09:44:34.709989879 +0000 UTC m=+90.568222227 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-metrics-certs") pod "router-default-858c855598-jhg2x" (UID: "ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd") : secret "router-metrics-certs-default" not found
Sep 14 09:44:32.710316 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:32.710281    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-service-ca-bundle podName:ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd nodeName:}" failed. No retries permitted until 2026-09-14 09:44:34.710267427 +0000 UTC m=+90.568499767 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-service-ca-bundle") pod "router-default-858c855598-jhg2x" (UID: "ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd") : configmap references non-existent config key: service-ca.crt
Sep 14 09:44:32.911396 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:32.911282    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c1229e7-9521-4b30-a1e3-09db80859a19-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-npw7b\" (UID: \"0c1229e7-9521-4b30-a1e3-09db80859a19\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-npw7b"
Sep 14 09:44:32.911592 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:32.911420    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 14 09:44:32.911592 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:32.911497    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c1229e7-9521-4b30-a1e3-09db80859a19-networking-console-plugin-cert podName:0c1229e7-9521-4b30-a1e3-09db80859a19 nodeName:}" failed. No retries permitted until 2026-09-14 09:44:34.911480756 +0000 UTC m=+90.769713093 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0c1229e7-9521-4b30-a1e3-09db80859a19-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-npw7b" (UID: "0c1229e7-9521-4b30-a1e3-09db80859a19") : secret "networking-console-plugin-cert" not found
Sep 14 09:44:34.727493 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:34.727452    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-metrics-certs\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:34.727975 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:34.727530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-service-ca-bundle\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:34.727975 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:34.727595    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 09:44:34.727975 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:34.727669    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-metrics-certs podName:ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd nodeName:}" failed. No retries permitted until 2026-09-14 09:44:38.72765049 +0000 UTC m=+94.585882830 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-metrics-certs") pod "router-default-858c855598-jhg2x" (UID: "ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd") : secret "router-metrics-certs-default" not found
Sep 14 09:44:34.727975 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:34.727702    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-service-ca-bundle podName:ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd nodeName:}" failed. No retries permitted until 2026-09-14 09:44:38.727682427 +0000 UTC m=+94.585914769 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-service-ca-bundle") pod "router-default-858c855598-jhg2x" (UID: "ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd") : configmap references non-existent config key: service-ca.crt
Sep 14 09:44:34.929485 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:34.929436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c1229e7-9521-4b30-a1e3-09db80859a19-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-npw7b\" (UID: \"0c1229e7-9521-4b30-a1e3-09db80859a19\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-npw7b"
Sep 14 09:44:34.930863 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:34.930830    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 14 09:44:34.930993 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:34.930916    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c1229e7-9521-4b30-a1e3-09db80859a19-networking-console-plugin-cert podName:0c1229e7-9521-4b30-a1e3-09db80859a19 nodeName:}" failed. No retries permitted until 2026-09-14 09:44:38.930896683 +0000 UTC m=+94.789129017 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0c1229e7-9521-4b30-a1e3-09db80859a19-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-npw7b" (UID: "0c1229e7-9521-4b30-a1e3-09db80859a19") : secret "networking-console-plugin-cert" not found
Sep 14 09:44:35.059526 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.059426    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wnntw" event={"ID":"bafdd1e7-cf34-4b63-9d55-9f5785b01ea3","Type":"ContainerStarted","Data":"34a7ab8769a02692acc083df7e2f0260c1955c0461d509e976ac15ed978fce7f"}
Sep 14 09:44:35.061111 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.061083    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-zst5h" event={"ID":"977c6b7b-d8e8-4b0d-b312-163d6fee715a","Type":"ContainerStarted","Data":"155b01413f65bde4bfef98dbf00347d6aa67fdd02cd9a237357d7dd0260dbd6c"}
Sep 14 09:44:35.086624 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.086570    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-lzhmx" podStartSLOduration=5.08655629 podStartE2EDuration="5.08655629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:44:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:44:32.070729458 +0000 UTC m=+87.928961812" watchObservedRunningTime="2026-09-14 09:44:35.08655629 +0000 UTC m=+90.944788654"
Sep 14 09:44:35.086871 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.086849    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wnntw" podStartSLOduration=1.884388907 podStartE2EDuration="4.08684271s" totalImagesPullingTime="2.202453803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:44:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:44:35.085493657 +0000 UTC m=+90.943726013" watchObservedRunningTime="2026-09-14 09:44:35.08684271 +0000 UTC m=+90.945075344"
Sep 14 09:44:35.112840 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.112787    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-zst5h" podStartSLOduration=2.699585582 podStartE2EDuration="5.112771714s" totalImagesPullingTime="2.413186132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:44:35.11266628 +0000 UTC m=+90.970898639" watchObservedRunningTime="2026-09-14 09:44:35.112771714 +0000 UTC m=+90.971004081"
Sep 14 09:44:35.589826 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.589760    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k9b5v"]
Sep 14 09:44:35.593152 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.593127    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:35.596420 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.596391    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 14 09:44:35.596420 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.596395    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 14 09:44:35.596599 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.596525    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-22v7l\""
Sep 14 09:44:35.605893 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.605866    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k9b5v"]
Sep 14 09:44:35.637669 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.637632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9bmm\" (UniqueName: \"kubernetes.io/projected/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-kube-api-access-l9bmm\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:35.637875 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.637685    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:35.637875 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.637768    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-crio-socket\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:35.637875 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.637841    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-data-volume\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:35.638021 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.637916    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:35.739253 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.739212    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-crio-socket\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:35.739253 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.739255    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-data-volume\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:35.739745 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.739306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:35.739745 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.739350    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-crio-socket\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:35.739745 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.739362    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9bmm\" (UniqueName: \"kubernetes.io/projected/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-kube-api-access-l9bmm\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:35.739745 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:35.739457    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 09:44:35.739745 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.739503    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:35.739745 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:35.739519    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-insights-runtime-extractor-tls podName:5d7cbfd3-b21a-474f-8dda-bf49fd28bc63 nodeName:}" failed. No retries permitted until 2026-09-14 09:44:36.239501346 +0000 UTC m=+92.097733695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k9b5v" (UID: "5d7cbfd3-b21a-474f-8dda-bf49fd28bc63") : secret "insights-runtime-extractor-tls" not found
Sep 14 09:44:35.739745 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:35.739553    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 09:44:35.739745 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:35.739599    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-kube-rbac-proxy-cm podName:5d7cbfd3-b21a-474f-8dda-bf49fd28bc63 nodeName:}" failed. No retries permitted until 2026-09-14 09:44:36.239582623 +0000 UTC m=+92.097814979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k9b5v" (UID: "5d7cbfd3-b21a-474f-8dda-bf49fd28bc63") : configmap "kube-rbac-proxy" not found
Sep 14 09:44:35.739745 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.739621    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-data-volume\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:35.748081 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:35.748055    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9bmm\" (UniqueName: \"kubernetes.io/projected/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-kube-api-access-l9bmm\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:36.244015 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:36.243977    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:36.244305 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:36.244038    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:36.244305 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:36.244124    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 09:44:36.244305 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:36.244149    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 09:44:36.244305 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:36.244191    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-kube-rbac-proxy-cm podName:5d7cbfd3-b21a-474f-8dda-bf49fd28bc63 nodeName:}" failed. No retries permitted until 2026-09-14 09:44:37.244172675 +0000 UTC m=+93.102405028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k9b5v" (UID: "5d7cbfd3-b21a-474f-8dda-bf49fd28bc63") : configmap "kube-rbac-proxy" not found
Sep 14 09:44:36.244305 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:36.244213    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-insights-runtime-extractor-tls podName:5d7cbfd3-b21a-474f-8dda-bf49fd28bc63 nodeName:}" failed. No retries permitted until 2026-09-14 09:44:37.24420368 +0000 UTC m=+93.102436019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k9b5v" (UID: "5d7cbfd3-b21a-474f-8dda-bf49fd28bc63") : secret "insights-runtime-extractor-tls" not found
Sep 14 09:44:37.252174 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:37.252136    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:37.252544 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:37.252198    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:37.252544 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:37.252280    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 09:44:37.252544 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:37.252288    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 09:44:37.252544 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:37.252331    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-kube-rbac-proxy-cm podName:5d7cbfd3-b21a-474f-8dda-bf49fd28bc63 nodeName:}" failed. No retries permitted until 2026-09-14 09:44:39.252318204 +0000 UTC m=+95.110550543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k9b5v" (UID: "5d7cbfd3-b21a-474f-8dda-bf49fd28bc63") : configmap "kube-rbac-proxy" not found
Sep 14 09:44:37.252544 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:37.252345    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-insights-runtime-extractor-tls podName:5d7cbfd3-b21a-474f-8dda-bf49fd28bc63 nodeName:}" failed. No retries permitted until 2026-09-14 09:44:39.252339282 +0000 UTC m=+95.110571616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k9b5v" (UID: "5d7cbfd3-b21a-474f-8dda-bf49fd28bc63") : secret "insights-runtime-extractor-tls" not found
Sep 14 09:44:38.530985 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:38.530954    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k4h57_af3b9fa5-b5eb-41b5-b21f-c3983847fb50/dns-node-resolver/0.log"
Sep 14 09:44:38.762900 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:38.762859    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-metrics-certs\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:38.763106 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:38.762926    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-service-ca-bundle\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:38.763106 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:38.763033    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 14 09:44:38.763106 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:38.763045    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-service-ca-bundle podName:ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd nodeName:}" failed. No retries permitted until 2026-09-14 09:44:46.763031496 +0000 UTC m=+102.621263834 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-service-ca-bundle") pod "router-default-858c855598-jhg2x" (UID: "ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd") : configmap references non-existent config key: service-ca.crt
Sep 14 09:44:38.763245 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:38.763109    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-metrics-certs podName:ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd nodeName:}" failed. No retries permitted until 2026-09-14 09:44:46.763091363 +0000 UTC m=+102.621323700 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-metrics-certs") pod "router-default-858c855598-jhg2x" (UID: "ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd") : secret "router-metrics-certs-default" not found
Sep 14 09:44:38.964835 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:38.964786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c1229e7-9521-4b30-a1e3-09db80859a19-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-npw7b\" (UID: \"0c1229e7-9521-4b30-a1e3-09db80859a19\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-npw7b"
Sep 14 09:44:38.965055 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:38.964953    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 14 09:44:38.965055 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:38.965032    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c1229e7-9521-4b30-a1e3-09db80859a19-networking-console-plugin-cert podName:0c1229e7-9521-4b30-a1e3-09db80859a19 nodeName:}" failed. No retries permitted until 2026-09-14 09:44:46.965011898 +0000 UTC m=+102.823244246 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0c1229e7-9521-4b30-a1e3-09db80859a19-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-npw7b" (UID: "0c1229e7-9521-4b30-a1e3-09db80859a19") : secret "networking-console-plugin-cert" not found
Sep 14 09:44:39.133359 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:39.133330    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c2bz4_66a14d90-706e-47be-b9bb-2adeb65103bf/node-ca/0.log"
Sep 14 09:44:39.267486 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:39.267383    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:39.267486 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:39.267485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:39.267687 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:39.267531    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 09:44:39.267687 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:39.267593    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 09:44:39.267687 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:39.267604    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-kube-rbac-proxy-cm podName:5d7cbfd3-b21a-474f-8dda-bf49fd28bc63 nodeName:}" failed. No retries permitted until 2026-09-14 09:44:43.267588049 +0000 UTC m=+99.125820386 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k9b5v" (UID: "5d7cbfd3-b21a-474f-8dda-bf49fd28bc63") : configmap "kube-rbac-proxy" not found
Sep 14 09:44:39.267687 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:39.267633    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-insights-runtime-extractor-tls podName:5d7cbfd3-b21a-474f-8dda-bf49fd28bc63 nodeName:}" failed. No retries permitted until 2026-09-14 09:44:43.267622343 +0000 UTC m=+99.125854677 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k9b5v" (UID: "5d7cbfd3-b21a-474f-8dda-bf49fd28bc63") : secret "insights-runtime-extractor-tls" not found
Sep 14 09:44:40.332163 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:40.332128    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rblrn_bb79a7dc-bd40-4f24-b163-973dc14c0cb4/serve-healthcheck-canary/0.log"
Sep 14 09:44:40.941252 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:40.941220    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-wnntw_bafdd1e7-cf34-4b63-9d55-9f5785b01ea3/kube-storage-version-migrator-operator/0.log"
Sep 14 09:44:42.895287 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:42.895246    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls\") pod \"dns-default-6zmdn\" (UID: \"59ba9674-e083-4b6a-b47b-8bf88d0f926c\") " pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:44:42.895703 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:42.895418    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 14 09:44:42.895703 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:42.895495    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls podName:59ba9674-e083-4b6a-b47b-8bf88d0f926c nodeName:}" failed. No retries permitted until 2026-09-14 09:45:46.895479358 +0000 UTC m=+162.753711693 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls") pod "dns-default-6zmdn" (UID: "59ba9674-e083-4b6a-b47b-8bf88d0f926c") : secret "dns-default-metrics-tls" not found
Sep 14 09:44:43.297862 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:43.297815    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:43.298034 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:43.297906    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:43.298034 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:43.297977    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 14 09:44:43.298110 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:43.298026    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 14 09:44:43.298110 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:43.298044    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-insights-runtime-extractor-tls podName:5d7cbfd3-b21a-474f-8dda-bf49fd28bc63 nodeName:}" failed. No retries permitted until 2026-09-14 09:44:51.298027136 +0000 UTC m=+107.156259481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k9b5v" (UID: "5d7cbfd3-b21a-474f-8dda-bf49fd28bc63") : secret "insights-runtime-extractor-tls" not found
Sep 14 09:44:43.298110 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:43.298082    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-kube-rbac-proxy-cm podName:5d7cbfd3-b21a-474f-8dda-bf49fd28bc63 nodeName:}" failed. No retries permitted until 2026-09-14 09:44:51.298069748 +0000 UTC m=+107.156302082 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k9b5v" (UID: "5d7cbfd3-b21a-474f-8dda-bf49fd28bc63") : configmap "kube-rbac-proxy" not found
Sep 14 09:44:46.003801 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:46.003768    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rfwwn"
Sep 14 09:44:46.829168 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:46.829118    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-metrics-certs\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:46.829362 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:46.829286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-service-ca-bundle\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:46.829983 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:46.829964    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-service-ca-bundle\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:46.831553 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:46.831531    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd-metrics-certs\") pod \"router-default-858c855598-jhg2x\" (UID: \"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd\") " pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:46.955031 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:46.954989    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:47.030674 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:47.030643    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c1229e7-9521-4b30-a1e3-09db80859a19-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-npw7b\" (UID: \"0c1229e7-9521-4b30-a1e3-09db80859a19\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-npw7b"
Sep 14 09:44:47.031008 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:47.030822    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 14 09:44:47.031008 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:44:47.030888    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c1229e7-9521-4b30-a1e3-09db80859a19-networking-console-plugin-cert podName:0c1229e7-9521-4b30-a1e3-09db80859a19 nodeName:}" failed. No retries permitted until 2026-09-14 09:45:03.030872859 +0000 UTC m=+118.889105212 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0c1229e7-9521-4b30-a1e3-09db80859a19-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-npw7b" (UID: "0c1229e7-9521-4b30-a1e3-09db80859a19") : secret "networking-console-plugin-cert" not found
Sep 14 09:44:47.270242 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:47.270198    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-858c855598-jhg2x"]
Sep 14 09:44:47.274570 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:44:47.274533    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce6f1ffd_ab92_4cde_ab15_ba7ec9200dfd.slice/crio-64967dbf5c39be26a99c6ed19446f57f2c6713e85f2328079024f0e88248720c WatchSource:0}: Error finding container 64967dbf5c39be26a99c6ed19446f57f2c6713e85f2328079024f0e88248720c: Status 404 returned error can't find the container with id 64967dbf5c39be26a99c6ed19446f57f2c6713e85f2328079024f0e88248720c
Sep 14 09:44:48.100499 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:48.100464    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-858c855598-jhg2x" event={"ID":"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd","Type":"ContainerStarted","Data":"00a6253364848b67ef21456b1354fb9b6411294fa6a365e3ce3e6702b78703d3"}
Sep 14 09:44:48.101024 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:48.100522    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-858c855598-jhg2x" event={"ID":"ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd","Type":"ContainerStarted","Data":"64967dbf5c39be26a99c6ed19446f57f2c6713e85f2328079024f0e88248720c"}
Sep 14 09:44:48.128219 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:48.128165    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-858c855598-jhg2x" podStartSLOduration=18.128147501 podStartE2EDuration="18.128147501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:44:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:44:48.127061585 +0000 UTC m=+103.985293940" watchObservedRunningTime="2026-09-14 09:44:48.128147501 +0000 UTC m=+103.986379856"
Sep 14 09:44:48.955494 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:48.955455    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:48.958224 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:48.958195    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:49.103482 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:49.103439    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:49.104650 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:49.104631    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-858c855598-jhg2x"
Sep 14 09:44:51.364778 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:51.364703    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:51.365172 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:51.364832    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:51.365238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:51.365219    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:51.367132 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:51.367108    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5d7cbfd3-b21a-474f-8dda-bf49fd28bc63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9b5v\" (UID: \"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63\") " pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:51.502594 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:51.502555    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k9b5v"
Sep 14 09:44:51.778731 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:51.778675    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k9b5v"]
Sep 14 09:44:51.783440 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:44:51.783403    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d7cbfd3_b21a_474f_8dda_bf49fd28bc63.slice/crio-90bf603b37ce5f9e25115eb4a0cb8f05de4046d0089c40e5cd5700b837473a2f WatchSource:0}: Error finding container 90bf603b37ce5f9e25115eb4a0cb8f05de4046d0089c40e5cd5700b837473a2f: Status 404 returned error can't find the container with id 90bf603b37ce5f9e25115eb4a0cb8f05de4046d0089c40e5cd5700b837473a2f
Sep 14 09:44:52.115081 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:52.114996    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9b5v" event={"ID":"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63","Type":"ContainerStarted","Data":"c640b1243fe174866896f90fe2f55d6b486c59b818e1f4d3258d84e6bc7310da"}
Sep 14 09:44:52.115081 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:52.115050    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9b5v" event={"ID":"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63","Type":"ContainerStarted","Data":"90bf603b37ce5f9e25115eb4a0cb8f05de4046d0089c40e5cd5700b837473a2f"}
Sep 14 09:44:53.120462 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:53.120423    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9b5v" event={"ID":"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63","Type":"ContainerStarted","Data":"ae55ecb5c26e0bf4be2f5bb294f52dde62a6435b351ac7ae7f8c77328a33b996"}
Sep 14 09:44:54.126015 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:54.125979    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9b5v" event={"ID":"5d7cbfd3-b21a-474f-8dda-bf49fd28bc63","Type":"ContainerStarted","Data":"2a85c1ac4c04051b69d295860b3f06bf6762047e1c335fdc108112d7f0dfdaaa"}
Sep 14 09:44:54.149800 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:44:54.149751    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k9b5v" podStartSLOduration=17.084083698 podStartE2EDuration="19.14973446s" totalImagesPullingTime="2.065650762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 09:44:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:44:54.147311816 +0000 UTC m=+110.005544171" watchObservedRunningTime="2026-09-14 09:44:54.14973446 +0000 UTC m=+110.007966826"
Sep 14 09:45:00.378021 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:00.377979    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"]
Sep 14 09:45:00.381223 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:00.381205    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"
Sep 14 09:45:00.384130 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:45:00.384096    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"open-cluster-management-image-pull-credentials\" is forbidden: User \"system:node:ip-10-0-132-247.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-132-247.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" type="*v1.Secret"
Sep 14 09:45:00.384338 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:45:00.384312    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-proxy-ca\" is forbidden: User \"system:node:ip-10-0-132-247.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-132-247.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" type="*v1.Secret"
Sep 14 09:45:00.384392 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:45:00.384326    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"cluster-proxy-proxy-agent-575d588bfb-qlvvt\" is forbidden: User \"system:node:ip-10-0-132-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-132-247.ec2.internal' and this object" podUID="6cd6783b-a7db-4713-855e-a92b8e50ce80" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"
Sep 14 09:45:00.384392 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:45:00.384314    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\" is forbidden: User \"system:node:ip-10-0-132-247.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-132-247.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" type="*v1.Secret"
Sep 14 09:45:00.385223 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:45:00.385189    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-proxy-service-proxy-server-certificates\" is forbidden: User \"system:node:ip-10-0-132-247.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-132-247.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" type="*v1.Secret"
Sep 14 09:45:00.385223 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:45:00.385202    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-132-247.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-132-247.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 14 09:45:00.385399 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:45:00.385223    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-132-247.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-132-247.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 14 09:45:00.385399 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:45:00.385223    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-proxy-hub-kubeconfig\" is forbidden: User \"system:node:ip-10-0-132-247.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-132-247.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" type="*v1.Secret"
Sep 14 09:45:00.420255 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:00.420222    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"]
Sep 14 09:45:00.537661 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:00.537616    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6cd6783b-a7db-4713-855e-a92b8e50ce80-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-575d588bfb-qlvvt\" (UID: \"6cd6783b-a7db-4713-855e-a92b8e50ce80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"
Sep 14 09:45:00.537867 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:00.537683    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khtpn\" (UniqueName: \"kubernetes.io/projected/6cd6783b-a7db-4713-855e-a92b8e50ce80-kube-api-access-khtpn\") pod \"cluster-proxy-proxy-agent-575d588bfb-qlvvt\" (UID: \"6cd6783b-a7db-4713-855e-a92b8e50ce80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"
Sep 14 09:45:00.537867 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:00.537801    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6cd6783b-a7db-4713-855e-a92b8e50ce80-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-575d588bfb-qlvvt\" (UID: \"6cd6783b-a7db-4713-855e-a92b8e50ce80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"
Sep 14 09:45:00.537867 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:00.537837    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6cd6783b-a7db-4713-855e-a92b8e50ce80-hub\") pod \"cluster-proxy-proxy-agent-575d588bfb-qlvvt\" (UID: \"6cd6783b-a7db-4713-855e-a92b8e50ce80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"
Sep 14 09:45:00.537867 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:00.537867    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6cd6783b-a7db-4713-855e-a92b8e50ce80-ca\") pod \"cluster-proxy-proxy-agent-575d588bfb-qlvvt\" (UID: \"6cd6783b-a7db-4713-855e-a92b8e50ce80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"
Sep 14 09:45:00.538021 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:00.537893    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cd6783b-a7db-4713-855e-a92b8e50ce80-additional-service-ca\") pod \"cluster-proxy-proxy-agent-575d588bfb-qlvvt\" (UID: \"6cd6783b-a7db-4713-855e-a92b8e50ce80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"
Sep 14 09:45:00.639165 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:00.639062    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6cd6783b-a7db-4713-855e-a92b8e50ce80-ca\") pod \"cluster-proxy-proxy-agent-575d588bfb-qlvvt\" (UID: \"6cd6783b-a7db-4713-855e-a92b8e50ce80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"
Sep 14 09:45:00.639165 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:00.639112    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cd6783b-a7db-4713-855e-a92b8e50ce80-additional-service-ca\") pod \"cluster-proxy-proxy-agent-575d588bfb-qlvvt\" (UID: \"6cd6783b-a7db-4713-855e-a92b8e50ce80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"
Sep 14 09:45:00.639165 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:00.639150    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6cd6783b-a7db-4713-855e-a92b8e50ce80-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-575d588bfb-qlvvt\" (UID: \"6cd6783b-a7db-4713-855e-a92b8e50ce80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"
Sep 14 09:45:00.639488 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:00.639202    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khtpn\" (UniqueName: \"kubernetes.io/projected/6cd6783b-a7db-4713-855e-a92b8e50ce80-kube-api-access-khtpn\") pod \"cluster-proxy-proxy-agent-575d588bfb-qlvvt\" (UID: \"6cd6783b-a7db-4713-855e-a92b8e50ce80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"
Sep 14 09:45:00.639488 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:00.639244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6cd6783b-a7db-4713-855e-a92b8e50ce80-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-575d588bfb-qlvvt\" (UID: \"6cd6783b-a7db-4713-855e-a92b8e50ce80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"
Sep 14 09:45:00.639488 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:00.639273    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6cd6783b-a7db-4713-855e-a92b8e50ce80-hub\") pod \"cluster-proxy-proxy-agent-575d588bfb-qlvvt\" (UID: \"6cd6783b-a7db-4713-855e-a92b8e50ce80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"
Sep 14 09:45:01.199634 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:01.199595    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 14 09:45:01.210702 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:01.210665    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cd6783b-a7db-4713-855e-a92b8e50ce80-additional-service-ca\") pod \"cluster-proxy-proxy-agent-575d588bfb-qlvvt\" (UID: \"6cd6783b-a7db-4713-855e-a92b8e50ce80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"
Sep 14 09:45:01.377071 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:01.377041    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 14 09:45:01.380965 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:01.380945    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 14 09:45:01.382483 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:01.382460    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6cd6783b-a7db-4713-855e-a92b8e50ce80-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-575d588bfb-qlvvt\" (UID: \"6cd6783b-a7db-4713-855e-a92b8e50ce80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"
Sep 14 09:45:01.390955 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:01.390932    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 14 09:45:01.391454 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:01.391436    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6cd6783b-a7db-4713-855e-a92b8e50ce80-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-575d588bfb-qlvvt\" (UID: \"6cd6783b-a7db-4713-855e-a92b8e50ce80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"
Sep 14 09:45:01.400566 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:01.400547    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khtpn\" (UniqueName: \"kubernetes.io/projected/6cd6783b-a7db-4713-855e-a92b8e50ce80-kube-api-access-khtpn\") pod \"cluster-proxy-proxy-agent-575d588bfb-qlvvt\" (UID: \"6cd6783b-a7db-4713-855e-a92b8e50ce80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"
Sep 14 09:45:01.519501 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:01.519410    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 14 09:45:01.521783 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:01.521762    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6cd6783b-a7db-4713-855e-a92b8e50ce80-hub\") pod \"cluster-proxy-proxy-agent-575d588bfb-qlvvt\" (UID: \"6cd6783b-a7db-4713-855e-a92b8e50ce80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"
Sep 14 09:45:01.623689 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:01.623655    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 14 09:45:01.631792 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:01.631767    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6cd6783b-a7db-4713-855e-a92b8e50ce80-ca\") pod \"cluster-proxy-proxy-agent-575d588bfb-qlvvt\" (UID: \"6cd6783b-a7db-4713-855e-a92b8e50ce80\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"
Sep 14 09:45:01.729601 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:01.729569    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 14 09:45:01.896259 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:01.896187    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"
Sep 14 09:45:02.168445 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:02.168416    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt"]
Sep 14 09:45:02.170928 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:45:02.170898    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6cd6783b_a7db_4713_855e_a92b8e50ce80.slice/crio-d056086e53f1d34f6b98cc35df1b8bc120973f46bbe6d5f222af156caed39276 WatchSource:0}: Error finding container d056086e53f1d34f6b98cc35df1b8bc120973f46bbe6d5f222af156caed39276: Status 404 returned error can't find the container with id d056086e53f1d34f6b98cc35df1b8bc120973f46bbe6d5f222af156caed39276
Sep 14 09:45:03.061060 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:03.061019    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c1229e7-9521-4b30-a1e3-09db80859a19-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-npw7b\" (UID: \"0c1229e7-9521-4b30-a1e3-09db80859a19\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-npw7b"
Sep 14 09:45:03.064095 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:03.064040    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c1229e7-9521-4b30-a1e3-09db80859a19-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-npw7b\" (UID: \"0c1229e7-9521-4b30-a1e3-09db80859a19\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-npw7b"
Sep 14 09:45:03.156420 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:03.156375    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt" event={"ID":"6cd6783b-a7db-4713-855e-a92b8e50ce80","Type":"ContainerStarted","Data":"d056086e53f1d34f6b98cc35df1b8bc120973f46bbe6d5f222af156caed39276"}
Sep 14 09:45:03.362946 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:03.362869    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-npw7b"
Sep 14 09:45:04.445094 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:04.445051    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-npw7b"]
Sep 14 09:45:04.448996 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:45:04.448964    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c1229e7_9521_4b30_a1e3_09db80859a19.slice/crio-b1fecdd19d5266ceba76d5c42b767d1cd5df2aef4ac869f25dc44474a0776844 WatchSource:0}: Error finding container b1fecdd19d5266ceba76d5c42b767d1cd5df2aef4ac869f25dc44474a0776844: Status 404 returned error can't find the container with id b1fecdd19d5266ceba76d5c42b767d1cd5df2aef4ac869f25dc44474a0776844
Sep 14 09:45:05.164460 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:05.164411    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-npw7b" event={"ID":"0c1229e7-9521-4b30-a1e3-09db80859a19","Type":"ContainerStarted","Data":"b1fecdd19d5266ceba76d5c42b767d1cd5df2aef4ac869f25dc44474a0776844"}
Sep 14 09:45:06.172785 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:06.172671    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt" event={"ID":"6cd6783b-a7db-4713-855e-a92b8e50ce80","Type":"ContainerStarted","Data":"988e17d93ccc97aecebcfb5ecf4ac2a8dc465235091a3150f42f2d803cf56c0a"}
Sep 14 09:45:06.173426 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:06.173244    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt" event={"ID":"6cd6783b-a7db-4713-855e-a92b8e50ce80","Type":"ContainerStarted","Data":"342761ce003e1be53654221faad2f1424fc25a8943d4412623eb5eb2da8780ca"}
Sep 14 09:45:06.173426 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:06.173284    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt" event={"ID":"6cd6783b-a7db-4713-855e-a92b8e50ce80","Type":"ContainerStarted","Data":"c75ba44934ad8cbdee4851ec86af5a34414195fdcb7550c176a580372270c782"}
Sep 14 09:45:06.199150 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:06.199080    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-575d588bfb-qlvvt" podStartSLOduration=2.633120748 podStartE2EDuration="6.199056961s" totalImagesPullingTime="3.565936213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:45:06.196959593 +0000 UTC m=+122.055191980" watchObservedRunningTime="2026-09-14 09:45:06.199056961 +0000 UTC m=+122.057289319"
Sep 14 09:45:07.177971 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:07.177872    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-npw7b" event={"ID":"0c1229e7-9521-4b30-a1e3-09db80859a19","Type":"ContainerStarted","Data":"0ff1874fff2f72ac246b1c60b8f6c8853fc945dd65b67692d3d2b368cccb7fc3"}
Sep 14 09:45:07.196962 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:07.196896    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-npw7b" podStartSLOduration=33.900407812 podStartE2EDuration="36.196881143s" totalImagesPullingTime="2.296473331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:44:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:45:07.19619774 +0000 UTC m=+123.054430115" watchObservedRunningTime="2026-09-14 09:45:07.196881143 +0000 UTC m=+123.055113498"
Sep 14 09:45:11.314313 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.314264    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5"]
Sep 14 09:45:11.318701 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.318675    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5"
Sep 14 09:45:11.321821 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.321798    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mgczk\""
Sep 14 09:45:11.323201 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.323179    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 14 09:45:11.323313 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.323229    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 14 09:45:11.323313 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.323274    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 14 09:45:11.323417 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.323234    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 14 09:45:11.323417 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.323229    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 14 09:45:11.324745 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.324717    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9smc\" (UniqueName: \"kubernetes.io/projected/92386275-cf0f-4ac9-a28d-fbfbe73481dd-kube-api-access-x9smc\") pod \"prometheus-operator-68bcd7f987-vk9x5\" (UID: \"92386275-cf0f-4ac9-a28d-fbfbe73481dd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5"
Sep 14 09:45:11.324837 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.324786    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92386275-cf0f-4ac9-a28d-fbfbe73481dd-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-vk9x5\" (UID: \"92386275-cf0f-4ac9-a28d-fbfbe73481dd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5"
Sep 14 09:45:11.324887 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.324868    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/92386275-cf0f-4ac9-a28d-fbfbe73481dd-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-vk9x5\" (UID: \"92386275-cf0f-4ac9-a28d-fbfbe73481dd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5"
Sep 14 09:45:11.325259 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.324933    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92386275-cf0f-4ac9-a28d-fbfbe73481dd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-vk9x5\" (UID: \"92386275-cf0f-4ac9-a28d-fbfbe73481dd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5"
Sep 14 09:45:11.328420 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.328399    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5"]
Sep 14 09:45:11.425490 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.425452    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9smc\" (UniqueName: \"kubernetes.io/projected/92386275-cf0f-4ac9-a28d-fbfbe73481dd-kube-api-access-x9smc\") pod \"prometheus-operator-68bcd7f987-vk9x5\" (UID: \"92386275-cf0f-4ac9-a28d-fbfbe73481dd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5"
Sep 14 09:45:11.425490 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.425496    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92386275-cf0f-4ac9-a28d-fbfbe73481dd-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-vk9x5\" (UID: \"92386275-cf0f-4ac9-a28d-fbfbe73481dd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5"
Sep 14 09:45:11.425807 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.425524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/92386275-cf0f-4ac9-a28d-fbfbe73481dd-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-vk9x5\" (UID: \"92386275-cf0f-4ac9-a28d-fbfbe73481dd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5"
Sep 14 09:45:11.425807 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.425552    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92386275-cf0f-4ac9-a28d-fbfbe73481dd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-vk9x5\" (UID: \"92386275-cf0f-4ac9-a28d-fbfbe73481dd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5"
Sep 14 09:45:11.425807 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:45:11.425630    2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 14 09:45:11.425807 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:45:11.425697    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92386275-cf0f-4ac9-a28d-fbfbe73481dd-prometheus-operator-tls podName:92386275-cf0f-4ac9-a28d-fbfbe73481dd nodeName:}" failed. No retries permitted until 2026-09-14 09:45:11.925682566 +0000 UTC m=+127.783914900 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/92386275-cf0f-4ac9-a28d-fbfbe73481dd-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-vk9x5" (UID: "92386275-cf0f-4ac9-a28d-fbfbe73481dd") : secret "prometheus-operator-tls" not found
Sep 14 09:45:11.426201 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.426179    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92386275-cf0f-4ac9-a28d-fbfbe73481dd-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-vk9x5\" (UID: \"92386275-cf0f-4ac9-a28d-fbfbe73481dd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5"
Sep 14 09:45:11.427988 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.427967    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92386275-cf0f-4ac9-a28d-fbfbe73481dd-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-vk9x5\" (UID: \"92386275-cf0f-4ac9-a28d-fbfbe73481dd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5"
Sep 14 09:45:11.445155 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.445116    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9smc\" (UniqueName: \"kubernetes.io/projected/92386275-cf0f-4ac9-a28d-fbfbe73481dd-kube-api-access-x9smc\") pod \"prometheus-operator-68bcd7f987-vk9x5\" (UID: \"92386275-cf0f-4ac9-a28d-fbfbe73481dd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5"
Sep 14 09:45:11.929466 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.929420    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/92386275-cf0f-4ac9-a28d-fbfbe73481dd-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-vk9x5\" (UID: \"92386275-cf0f-4ac9-a28d-fbfbe73481dd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5"
Sep 14 09:45:11.931895 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:11.931875    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/92386275-cf0f-4ac9-a28d-fbfbe73481dd-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-vk9x5\" (UID: \"92386275-cf0f-4ac9-a28d-fbfbe73481dd\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5"
Sep 14 09:45:12.227569 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:12.227465    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5"
Sep 14 09:45:12.500558 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:12.500476    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5"]
Sep 14 09:45:12.503270 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:45:12.503239    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92386275_cf0f_4ac9_a28d_fbfbe73481dd.slice/crio-0e39c0fa87168b9ee109f7f5965be4484c9563b84d0a6bba29b327ed2f392054 WatchSource:0}: Error finding container 0e39c0fa87168b9ee109f7f5965be4484c9563b84d0a6bba29b327ed2f392054: Status 404 returned error can't find the container with id 0e39c0fa87168b9ee109f7f5965be4484c9563b84d0a6bba29b327ed2f392054
Sep 14 09:45:13.198909 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:13.198873    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5" event={"ID":"92386275-cf0f-4ac9-a28d-fbfbe73481dd","Type":"ContainerStarted","Data":"0e39c0fa87168b9ee109f7f5965be4484c9563b84d0a6bba29b327ed2f392054"}
Sep 14 09:45:13.440859 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:13.440815    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs\") pod \"network-metrics-daemon-wlcmj\" (UID: \"930e6273-c402-447a-ade0-f00b6248df0d\") " pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:45:13.443529 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:13.443493    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/930e6273-c402-447a-ade0-f00b6248df0d-metrics-certs\") pod \"network-metrics-daemon-wlcmj\" (UID: \"930e6273-c402-447a-ade0-f00b6248df0d\") " pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:45:13.563212 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:13.563127    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9ctbn\""
Sep 14 09:45:13.570976 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:13.570948    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wlcmj"
Sep 14 09:45:13.957836 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:13.957760    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wlcmj"]
Sep 14 09:45:13.961148 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:45:13.960509    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod930e6273_c402_447a_ade0_f00b6248df0d.slice/crio-2e706e30c0d3c7d0f7694534bcb3c643b7870c73fe74657b201947a6ccfa85bc WatchSource:0}: Error finding container 2e706e30c0d3c7d0f7694534bcb3c643b7870c73fe74657b201947a6ccfa85bc: Status 404 returned error can't find the container with id 2e706e30c0d3c7d0f7694534bcb3c643b7870c73fe74657b201947a6ccfa85bc
Sep 14 09:45:14.204261 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:14.204227    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5" event={"ID":"92386275-cf0f-4ac9-a28d-fbfbe73481dd","Type":"ContainerStarted","Data":"16dc90e6234549e79e4d8ee106b0bf181cdee7773b67e50703faab3371d12b89"}
Sep 14 09:45:14.204465 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:14.204288    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5" event={"ID":"92386275-cf0f-4ac9-a28d-fbfbe73481dd","Type":"ContainerStarted","Data":"2e1554b4b85a722d060469c4ec5cd9b3a9cb4663176753d5acf8828dd1da4787"}
Sep 14 09:45:14.205384 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:14.205363    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wlcmj" event={"ID":"930e6273-c402-447a-ade0-f00b6248df0d","Type":"ContainerStarted","Data":"2e706e30c0d3c7d0f7694534bcb3c643b7870c73fe74657b201947a6ccfa85bc"}
Sep 14 09:45:14.225660 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:14.225611    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-vk9x5" podStartSLOduration=1.995796658 podStartE2EDuration="3.225593838s" totalImagesPullingTime="1.22979718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:45:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:45:14.224028428 +0000 UTC m=+130.082260807" watchObservedRunningTime="2026-09-14 09:45:14.225593838 +0000 UTC m=+130.083826194"
Sep 14 09:45:15.210265 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.210222    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wlcmj" event={"ID":"930e6273-c402-447a-ade0-f00b6248df0d","Type":"ContainerStarted","Data":"e17934b5ed81ae04bad64f83da721b8ea3dc2e61521596402018fceceff449c0"}
Sep 14 09:45:15.210629 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.210293    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wlcmj" event={"ID":"930e6273-c402-447a-ade0-f00b6248df0d","Type":"ContainerStarted","Data":"e7c0fdb6b6419fa22edda21b329c85db7cd928f97d78f81bec71cb47fd825985"}
Sep 14 09:45:15.228384 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.228278    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wlcmj" podStartSLOduration=130.228818324 podStartE2EDuration="2m11.22826119s" totalImagesPullingTime="999.442866ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:45:15.227833687 +0000 UTC m=+131.086066044" watchObservedRunningTime="2026-09-14 09:45:15.22826119 +0000 UTC m=+131.086493546"
Sep 14 09:45:15.690058 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.690016    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hl94r"]
Sep 14 09:45:15.693306 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.693285    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.695939 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.695917    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 14 09:45:15.696063 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.695939    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 14 09:45:15.696108 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.696092    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ghd85\""
Sep 14 09:45:15.696220 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.696205    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 14 09:45:15.757813 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.757773    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e263423-fd60-485c-86ab-0f5ddd78a18e-sys\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.757813 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.757813    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e263423-fd60-485c-86ab-0f5ddd78a18e-metrics-client-ca\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.758036 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.757835    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b54g9\" (UniqueName: \"kubernetes.io/projected/8e263423-fd60-485c-86ab-0f5ddd78a18e-kube-api-access-b54g9\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.758036 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.757904    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e263423-fd60-485c-86ab-0f5ddd78a18e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.758036 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.757964    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e263423-fd60-485c-86ab-0f5ddd78a18e-node-exporter-tls\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.758036 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.758013    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8e263423-fd60-485c-86ab-0f5ddd78a18e-node-exporter-accelerators-collector-config\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.758160 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.758058    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8e263423-fd60-485c-86ab-0f5ddd78a18e-node-exporter-textfile\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.758160 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.758089    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8e263423-fd60-485c-86ab-0f5ddd78a18e-root\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.758160 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.758105    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8e263423-fd60-485c-86ab-0f5ddd78a18e-node-exporter-wtmp\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.858489 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.858454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e263423-fd60-485c-86ab-0f5ddd78a18e-node-exporter-tls\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.858489 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.858495    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8e263423-fd60-485c-86ab-0f5ddd78a18e-node-exporter-accelerators-collector-config\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.858767 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.858515    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8e263423-fd60-485c-86ab-0f5ddd78a18e-node-exporter-textfile\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.858767 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.858536    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8e263423-fd60-485c-86ab-0f5ddd78a18e-root\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.858767 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.858559    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8e263423-fd60-485c-86ab-0f5ddd78a18e-node-exporter-wtmp\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.858767 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.858600    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e263423-fd60-485c-86ab-0f5ddd78a18e-sys\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.858767 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.858620    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e263423-fd60-485c-86ab-0f5ddd78a18e-metrics-client-ca\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.858767 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:45:15.858624    2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 14 09:45:15.858767 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.858649    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b54g9\" (UniqueName: \"kubernetes.io/projected/8e263423-fd60-485c-86ab-0f5ddd78a18e-kube-api-access-b54g9\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.858767 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.858682    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e263423-fd60-485c-86ab-0f5ddd78a18e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.858767 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:45:15.858698    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e263423-fd60-485c-86ab-0f5ddd78a18e-node-exporter-tls podName:8e263423-fd60-485c-86ab-0f5ddd78a18e nodeName:}" failed. No retries permitted until 2026-09-14 09:45:16.358676625 +0000 UTC m=+132.216908963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8e263423-fd60-485c-86ab-0f5ddd78a18e-node-exporter-tls") pod "node-exporter-hl94r" (UID: "8e263423-fd60-485c-86ab-0f5ddd78a18e") : secret "node-exporter-tls" not found
Sep 14 09:45:15.858767 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.858624    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8e263423-fd60-485c-86ab-0f5ddd78a18e-root\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.859137 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.858770    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8e263423-fd60-485c-86ab-0f5ddd78a18e-node-exporter-wtmp\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.859137 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.858837    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e263423-fd60-485c-86ab-0f5ddd78a18e-sys\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.859137 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.858891    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8e263423-fd60-485c-86ab-0f5ddd78a18e-node-exporter-textfile\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.859230 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.859158    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8e263423-fd60-485c-86ab-0f5ddd78a18e-node-exporter-accelerators-collector-config\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.859302 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.859285    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e263423-fd60-485c-86ab-0f5ddd78a18e-metrics-client-ca\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.860873 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.860856    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e263423-fd60-485c-86ab-0f5ddd78a18e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:15.876290 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:15.876259    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b54g9\" (UniqueName: \"kubernetes.io/projected/8e263423-fd60-485c-86ab-0f5ddd78a18e-kube-api-access-b54g9\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:16.363184 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:16.363152    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e263423-fd60-485c-86ab-0f5ddd78a18e-node-exporter-tls\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:16.365436 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:16.365414    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e263423-fd60-485c-86ab-0f5ddd78a18e-node-exporter-tls\") pod \"node-exporter-hl94r\" (UID: \"8e263423-fd60-485c-86ab-0f5ddd78a18e\") " pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:16.602604 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:16.602575    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hl94r"
Sep 14 09:45:16.614454 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:45:16.614391    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e263423_fd60_485c_86ab_0f5ddd78a18e.slice/crio-d2b7ac17083438269e383a5b9f1f3f0428721ea59cc78f14f8470aae611540d5 WatchSource:0}: Error finding container d2b7ac17083438269e383a5b9f1f3f0428721ea59cc78f14f8470aae611540d5: Status 404 returned error can't find the container with id d2b7ac17083438269e383a5b9f1f3f0428721ea59cc78f14f8470aae611540d5
Sep 14 09:45:17.219657 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:17.219617    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hl94r" event={"ID":"8e263423-fd60-485c-86ab-0f5ddd78a18e","Type":"ContainerStarted","Data":"d2b7ac17083438269e383a5b9f1f3f0428721ea59cc78f14f8470aae611540d5"}
Sep 14 09:45:18.224988 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:18.224950    2581 generic.go:356] "Generic (PLEG): container finished" podID="8e263423-fd60-485c-86ab-0f5ddd78a18e" containerID="881253efa90e251c1450c14412c5f3964cfaefc06796b5914790530ff3f0f4ba" exitCode=0
Sep 14 09:45:18.225355 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:18.225005    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hl94r" event={"ID":"8e263423-fd60-485c-86ab-0f5ddd78a18e","Type":"ContainerDied","Data":"881253efa90e251c1450c14412c5f3964cfaefc06796b5914790530ff3f0f4ba"}
Sep 14 09:45:19.230669 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:19.230629    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hl94r" event={"ID":"8e263423-fd60-485c-86ab-0f5ddd78a18e","Type":"ContainerStarted","Data":"6653f37a5f4ea9aaf8d6272d1352c5cbe1a7665754d2541951ce306214d88c05"}
Sep 14 09:45:19.231079 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:19.230682    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hl94r" event={"ID":"8e263423-fd60-485c-86ab-0f5ddd78a18e","Type":"ContainerStarted","Data":"3ad850ccd3e6a70727c8d0e2b80978ddd9ac93c6cec883ef3fc863e9b4590656"}
Sep 14 09:45:19.259831 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:19.259774    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hl94r" podStartSLOduration=3.113623083 podStartE2EDuration="4.259753287s" totalImagesPullingTime="1.08484334s" totalInitContainerRuntime="61.286864ms" isStatefulPod=true podCreationTimestamp="2026-09-14 09:45:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:45:19.257819813 +0000 UTC m=+135.116052170" watchObservedRunningTime="2026-09-14 09:45:19.259753287 +0000 UTC m=+135.117985662"
Sep 14 09:45:20.507697 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.507661    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67454f647d-7x5tm"]
Sep 14 09:45:20.510952 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.510932    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.514648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.514623    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 14 09:45:20.514783 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.514623    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 14 09:45:20.514783 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.514736    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 14 09:45:20.516078 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.516055    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 14 09:45:20.516209 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.516124    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 14 09:45:20.516209 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.516135    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 14 09:45:20.516209 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.516193    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 14 09:45:20.516470 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.516449    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-stffz\""
Sep 14 09:45:20.520304 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.520278    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 14 09:45:20.527833 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.527805    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67454f647d-7x5tm"]
Sep 14 09:45:20.595222 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.595188    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e38a8cf5-4acb-4db7-b813-749473741671-console-oauth-config\") pod \"console-67454f647d-7x5tm\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") " pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.595386 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.595231    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-service-ca\") pod \"console-67454f647d-7x5tm\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") " pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.595386 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.595257    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-trusted-ca-bundle\") pod \"console-67454f647d-7x5tm\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") " pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.595386 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.595279    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e38a8cf5-4acb-4db7-b813-749473741671-console-serving-cert\") pod \"console-67454f647d-7x5tm\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") " pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.595386 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.595313    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-console-config\") pod \"console-67454f647d-7x5tm\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") " pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.595386 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.595347    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-oauth-serving-cert\") pod \"console-67454f647d-7x5tm\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") " pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.595551 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.595400    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdwb6\" (UniqueName: \"kubernetes.io/projected/e38a8cf5-4acb-4db7-b813-749473741671-kube-api-access-vdwb6\") pod \"console-67454f647d-7x5tm\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") " pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.696658 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.696618    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e38a8cf5-4acb-4db7-b813-749473741671-console-oauth-config\") pod \"console-67454f647d-7x5tm\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") " pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.696658 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.696660    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-service-ca\") pod \"console-67454f647d-7x5tm\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") " pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.696923 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.696677    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-trusted-ca-bundle\") pod \"console-67454f647d-7x5tm\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") " pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.696923 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.696694    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e38a8cf5-4acb-4db7-b813-749473741671-console-serving-cert\") pod \"console-67454f647d-7x5tm\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") " pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.696923 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.696742    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-console-config\") pod \"console-67454f647d-7x5tm\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") " pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.697086 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.696929    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-oauth-serving-cert\") pod \"console-67454f647d-7x5tm\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") " pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.697086 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.696978    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdwb6\" (UniqueName: \"kubernetes.io/projected/e38a8cf5-4acb-4db7-b813-749473741671-kube-api-access-vdwb6\") pod \"console-67454f647d-7x5tm\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") " pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.697503 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.697481    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-console-config\") pod \"console-67454f647d-7x5tm\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") " pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.697603 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.697549    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-service-ca\") pod \"console-67454f647d-7x5tm\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") " pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.697651 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.697620    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-trusted-ca-bundle\") pod \"console-67454f647d-7x5tm\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") " pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.697747 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.697732    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-oauth-serving-cert\") pod \"console-67454f647d-7x5tm\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") " pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.699764 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.699742    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e38a8cf5-4acb-4db7-b813-749473741671-console-serving-cert\") pod \"console-67454f647d-7x5tm\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") " pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.699836 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.699760    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e38a8cf5-4acb-4db7-b813-749473741671-console-oauth-config\") pod \"console-67454f647d-7x5tm\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") " pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.709984 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.709963    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdwb6\" (UniqueName: \"kubernetes.io/projected/e38a8cf5-4acb-4db7-b813-749473741671-kube-api-access-vdwb6\") pod \"console-67454f647d-7x5tm\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") " pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:20.820488 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:20.820390    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:21.094935 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:21.094896    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67454f647d-7x5tm"]
Sep 14 09:45:21.097493 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:45:21.097466    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode38a8cf5_4acb_4db7_b813_749473741671.slice/crio-f1ce3c8540d65ca3ef7c111bb1395e448c1ac7cdcef2d5e9cd2dde3a9a1e3f01 WatchSource:0}: Error finding container f1ce3c8540d65ca3ef7c111bb1395e448c1ac7cdcef2d5e9cd2dde3a9a1e3f01: Status 404 returned error can't find the container with id f1ce3c8540d65ca3ef7c111bb1395e448c1ac7cdcef2d5e9cd2dde3a9a1e3f01
Sep 14 09:45:21.238457 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:21.238417    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67454f647d-7x5tm" event={"ID":"e38a8cf5-4acb-4db7-b813-749473741671","Type":"ContainerStarted","Data":"f1ce3c8540d65ca3ef7c111bb1395e448c1ac7cdcef2d5e9cd2dde3a9a1e3f01"}
Sep 14 09:45:24.252594 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:24.252555    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67454f647d-7x5tm" event={"ID":"e38a8cf5-4acb-4db7-b813-749473741671","Type":"ContainerStarted","Data":"21d980ee60451c0a4e4732b730e9cb590d88b2d127ff66212dbee8fa836ab292"}
Sep 14 09:45:24.273758 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:24.273682    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67454f647d-7x5tm" podStartSLOduration=1.461047014 podStartE2EDuration="4.273666152s" totalImagesPullingTime="2.812619138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:45:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:45:24.273226626 +0000 UTC m=+140.131458984" watchObservedRunningTime="2026-09-14 09:45:24.273666152 +0000 UTC m=+140.131898509"
Sep 14 09:45:30.382408 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.382368    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67454f647d-7x5tm"]
Sep 14 09:45:30.442492 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.442458    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68b9dbf6c7-dqdpq"]
Sep 14 09:45:30.447830 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.447808    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.467172 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.467144    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68b9dbf6c7-dqdpq"]
Sep 14 09:45:30.481518 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.481487    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed757dc5-847d-487b-bd1f-24e5d6411e62-console-oauth-config\") pod \"console-68b9dbf6c7-dqdpq\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") " pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.481660 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.481537    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed757dc5-847d-487b-bd1f-24e5d6411e62-console-serving-cert\") pod \"console-68b9dbf6c7-dqdpq\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") " pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.481660 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.481607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-oauth-serving-cert\") pod \"console-68b9dbf6c7-dqdpq\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") " pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.481660 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.481625    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-service-ca\") pod \"console-68b9dbf6c7-dqdpq\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") " pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.481660 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.481642    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv4z9\" (UniqueName: \"kubernetes.io/projected/ed757dc5-847d-487b-bd1f-24e5d6411e62-kube-api-access-zv4z9\") pod \"console-68b9dbf6c7-dqdpq\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") " pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.481868 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.481735    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-console-config\") pod \"console-68b9dbf6c7-dqdpq\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") " pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.481868 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.481776    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-trusted-ca-bundle\") pod \"console-68b9dbf6c7-dqdpq\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") " pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.582966 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.582925    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-trusted-ca-bundle\") pod \"console-68b9dbf6c7-dqdpq\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") " pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.582966 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.582970    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed757dc5-847d-487b-bd1f-24e5d6411e62-console-oauth-config\") pod \"console-68b9dbf6c7-dqdpq\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") " pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.583224 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.583101    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed757dc5-847d-487b-bd1f-24e5d6411e62-console-serving-cert\") pod \"console-68b9dbf6c7-dqdpq\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") " pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.583224 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.583173    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-oauth-serving-cert\") pod \"console-68b9dbf6c7-dqdpq\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") " pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.583224 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.583206    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-service-ca\") pod \"console-68b9dbf6c7-dqdpq\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") " pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.583369 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.583230    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv4z9\" (UniqueName: \"kubernetes.io/projected/ed757dc5-847d-487b-bd1f-24e5d6411e62-kube-api-access-zv4z9\") pod \"console-68b9dbf6c7-dqdpq\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") " pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.583369 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.583277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-console-config\") pod \"console-68b9dbf6c7-dqdpq\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") " pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.583945 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.583919    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-oauth-serving-cert\") pod \"console-68b9dbf6c7-dqdpq\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") " pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.584054 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.583956    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-trusted-ca-bundle\") pod \"console-68b9dbf6c7-dqdpq\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") " pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.584054 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.584025    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-service-ca\") pod \"console-68b9dbf6c7-dqdpq\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") " pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.584054 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.584040    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-console-config\") pod \"console-68b9dbf6c7-dqdpq\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") " pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.585525 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.585498    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed757dc5-847d-487b-bd1f-24e5d6411e62-console-serving-cert\") pod \"console-68b9dbf6c7-dqdpq\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") " pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.585611 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.585538    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed757dc5-847d-487b-bd1f-24e5d6411e62-console-oauth-config\") pod \"console-68b9dbf6c7-dqdpq\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") " pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.594168 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.594144    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv4z9\" (UniqueName: \"kubernetes.io/projected/ed757dc5-847d-487b-bd1f-24e5d6411e62-kube-api-access-zv4z9\") pod \"console-68b9dbf6c7-dqdpq\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") " pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.757115 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.757064    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:30.821037 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:30.821002    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:31.032827 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:31.032748    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68b9dbf6c7-dqdpq"]
Sep 14 09:45:31.035808 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:45:31.035771    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded757dc5_847d_487b_bd1f_24e5d6411e62.slice/crio-e1cbbc9a840758e357a694d110181fd25b254e3387d0ba7b80c14368381c483d WatchSource:0}: Error finding container e1cbbc9a840758e357a694d110181fd25b254e3387d0ba7b80c14368381c483d: Status 404 returned error can't find the container with id e1cbbc9a840758e357a694d110181fd25b254e3387d0ba7b80c14368381c483d
Sep 14 09:45:31.277803 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:31.277767    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68b9dbf6c7-dqdpq" event={"ID":"ed757dc5-847d-487b-bd1f-24e5d6411e62","Type":"ContainerStarted","Data":"c26f82bcbca2dd529e10166ea149340a4f87eb07bde1e5a7c3413de18ae157a4"}
Sep 14 09:45:31.278004 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:31.277819    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68b9dbf6c7-dqdpq" event={"ID":"ed757dc5-847d-487b-bd1f-24e5d6411e62","Type":"ContainerStarted","Data":"e1cbbc9a840758e357a694d110181fd25b254e3387d0ba7b80c14368381c483d"}
Sep 14 09:45:31.301221 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:31.301098    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68b9dbf6c7-dqdpq" podStartSLOduration=1.301081149 podStartE2EDuration="1.301081149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:45:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:45:31.300518341 +0000 UTC m=+147.158750729" watchObservedRunningTime="2026-09-14 09:45:31.301081149 +0000 UTC m=+147.159313505"
Sep 14 09:45:40.757561 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:40.757507    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:40.758103 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:40.757585    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:40.762604 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:40.762576    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:41.318571 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:41.318541    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:45:42.056367 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:45:42.056298    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6zmdn" podUID="59ba9674-e083-4b6a-b47b-8bf88d0f926c"
Sep 14 09:45:42.318384 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:42.318308    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:45:46.924624 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:46.924582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls\") pod \"dns-default-6zmdn\" (UID: \"59ba9674-e083-4b6a-b47b-8bf88d0f926c\") " pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:45:46.926863 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:46.926841    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59ba9674-e083-4b6a-b47b-8bf88d0f926c-metrics-tls\") pod \"dns-default-6zmdn\" (UID: \"59ba9674-e083-4b6a-b47b-8bf88d0f926c\") " pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:45:47.122279 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:47.122244    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hwxbr\""
Sep 14 09:45:47.129917 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:47.129891    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:45:47.410433 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:47.410404    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6zmdn"]
Sep 14 09:45:47.412877 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:45:47.412848    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ba9674_e083_4b6a_b47b_8bf88d0f926c.slice/crio-9fb5239032fcc5d96cf47db8a2d952d599a8cbb80e4325567963bd5dd5c3a8df WatchSource:0}: Error finding container 9fb5239032fcc5d96cf47db8a2d952d599a8cbb80e4325567963bd5dd5c3a8df: Status 404 returned error can't find the container with id 9fb5239032fcc5d96cf47db8a2d952d599a8cbb80e4325567963bd5dd5c3a8df
Sep 14 09:45:48.347345 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:48.347297    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6zmdn" event={"ID":"59ba9674-e083-4b6a-b47b-8bf88d0f926c","Type":"ContainerStarted","Data":"9fb5239032fcc5d96cf47db8a2d952d599a8cbb80e4325567963bd5dd5c3a8df"}
Sep 14 09:45:49.354625 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:49.354585    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6zmdn" event={"ID":"59ba9674-e083-4b6a-b47b-8bf88d0f926c","Type":"ContainerStarted","Data":"348745b0592c456501fddf331fbd15ad1f12c9199789b6baae4a0a031e8b86ba"}
Sep 14 09:45:50.360393 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:50.360359    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6zmdn" event={"ID":"59ba9674-e083-4b6a-b47b-8bf88d0f926c","Type":"ContainerStarted","Data":"06e71edcaab7e79a332837552959fe1e6f40220f5f384a25f756b3dcf075332b"}
Sep 14 09:45:50.360770 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:50.360488    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:45:50.386141 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:50.386092    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6zmdn" podStartSLOduration=130.570386321 podStartE2EDuration="2m12.386076631s" totalImagesPullingTime="1.81569031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:43:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:45:50.385210026 +0000 UTC m=+166.243442382" watchObservedRunningTime="2026-09-14 09:45:50.386076631 +0000 UTC m=+166.244308986"
Sep 14 09:45:55.401251 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.401185    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67454f647d-7x5tm" podUID="e38a8cf5-4acb-4db7-b813-749473741671" containerName="console" containerID="cri-o://21d980ee60451c0a4e4732b730e9cb590d88b2d127ff66212dbee8fa836ab292" gracePeriod=15
Sep 14 09:45:55.655626 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.655566    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:55.802702 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.802657    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-trusted-ca-bundle\") pod \"e38a8cf5-4acb-4db7-b813-749473741671\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") "
Sep 14 09:45:55.802702 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.802700    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e38a8cf5-4acb-4db7-b813-749473741671-console-serving-cert\") pod \"e38a8cf5-4acb-4db7-b813-749473741671\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") "
Sep 14 09:45:55.802987 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.802749    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-console-config\") pod \"e38a8cf5-4acb-4db7-b813-749473741671\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") "
Sep 14 09:45:55.802987 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.802766    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdwb6\" (UniqueName: \"kubernetes.io/projected/e38a8cf5-4acb-4db7-b813-749473741671-kube-api-access-vdwb6\") pod \"e38a8cf5-4acb-4db7-b813-749473741671\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") "
Sep 14 09:45:55.802987 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.802819    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e38a8cf5-4acb-4db7-b813-749473741671-console-oauth-config\") pod \"e38a8cf5-4acb-4db7-b813-749473741671\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") "
Sep 14 09:45:55.802987 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.802853    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-service-ca\") pod \"e38a8cf5-4acb-4db7-b813-749473741671\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") "
Sep 14 09:45:55.802987 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.802940    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-oauth-serving-cert\") pod \"e38a8cf5-4acb-4db7-b813-749473741671\" (UID: \"e38a8cf5-4acb-4db7-b813-749473741671\") "
Sep 14 09:45:55.803219 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.803139    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e38a8cf5-4acb-4db7-b813-749473741671" (UID: "e38a8cf5-4acb-4db7-b813-749473741671"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 09:45:55.803288 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.803230    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-console-config" (OuterVolumeSpecName: "console-config") pod "e38a8cf5-4acb-4db7-b813-749473741671" (UID: "e38a8cf5-4acb-4db7-b813-749473741671"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 09:45:55.803288 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.803235    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-trusted-ca-bundle\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:45:55.803288 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.803243    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-service-ca" (OuterVolumeSpecName: "service-ca") pod "e38a8cf5-4acb-4db7-b813-749473741671" (UID: "e38a8cf5-4acb-4db7-b813-749473741671"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 09:45:55.803455 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.803436    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e38a8cf5-4acb-4db7-b813-749473741671" (UID: "e38a8cf5-4acb-4db7-b813-749473741671"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 09:45:55.805198 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.805163    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e38a8cf5-4acb-4db7-b813-749473741671-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e38a8cf5-4acb-4db7-b813-749473741671" (UID: "e38a8cf5-4acb-4db7-b813-749473741671"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 09:45:55.805198 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.805186    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e38a8cf5-4acb-4db7-b813-749473741671-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e38a8cf5-4acb-4db7-b813-749473741671" (UID: "e38a8cf5-4acb-4db7-b813-749473741671"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 09:45:55.805381 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.805217    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e38a8cf5-4acb-4db7-b813-749473741671-kube-api-access-vdwb6" (OuterVolumeSpecName: "kube-api-access-vdwb6") pod "e38a8cf5-4acb-4db7-b813-749473741671" (UID: "e38a8cf5-4acb-4db7-b813-749473741671"). InnerVolumeSpecName "kube-api-access-vdwb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 09:45:55.903804 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.903762    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e38a8cf5-4acb-4db7-b813-749473741671-console-oauth-config\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:45:55.903804 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.903794    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-service-ca\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:45:55.903804 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.903804    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-oauth-serving-cert\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:45:55.903804 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.903813    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e38a8cf5-4acb-4db7-b813-749473741671-console-serving-cert\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:45:55.904056 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.903823    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e38a8cf5-4acb-4db7-b813-749473741671-console-config\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:45:55.904056 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:55.903831    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdwb6\" (UniqueName: \"kubernetes.io/projected/e38a8cf5-4acb-4db7-b813-749473741671-kube-api-access-vdwb6\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:45:56.384625 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:56.384575    2581 generic.go:356] "Generic (PLEG): container finished" podID="e38a8cf5-4acb-4db7-b813-749473741671" containerID="21d980ee60451c0a4e4732b730e9cb590d88b2d127ff66212dbee8fa836ab292" exitCode=0
Sep 14 09:45:56.384625 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:56.384622    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67454f647d-7x5tm"
Sep 14 09:45:56.384923 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:56.384652    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67454f647d-7x5tm" event={"ID":"e38a8cf5-4acb-4db7-b813-749473741671","Type":"ContainerDied","Data":"21d980ee60451c0a4e4732b730e9cb590d88b2d127ff66212dbee8fa836ab292"}
Sep 14 09:45:56.384923 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:56.384732    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67454f647d-7x5tm" event={"ID":"e38a8cf5-4acb-4db7-b813-749473741671","Type":"ContainerDied","Data":"f1ce3c8540d65ca3ef7c111bb1395e448c1ac7cdcef2d5e9cd2dde3a9a1e3f01"}
Sep 14 09:45:56.384923 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:56.384763    2581 scope.go:117] "RemoveContainer" containerID="21d980ee60451c0a4e4732b730e9cb590d88b2d127ff66212dbee8fa836ab292"
Sep 14 09:45:56.393611 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:56.393589    2581 scope.go:117] "RemoveContainer" containerID="21d980ee60451c0a4e4732b730e9cb590d88b2d127ff66212dbee8fa836ab292"
Sep 14 09:45:56.393991 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:45:56.393971    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21d980ee60451c0a4e4732b730e9cb590d88b2d127ff66212dbee8fa836ab292\": container with ID starting with 21d980ee60451c0a4e4732b730e9cb590d88b2d127ff66212dbee8fa836ab292 not found: ID does not exist" containerID="21d980ee60451c0a4e4732b730e9cb590d88b2d127ff66212dbee8fa836ab292"
Sep 14 09:45:56.394062 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:56.394003    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21d980ee60451c0a4e4732b730e9cb590d88b2d127ff66212dbee8fa836ab292"} err="failed to get container status \"21d980ee60451c0a4e4732b730e9cb590d88b2d127ff66212dbee8fa836ab292\": rpc error: code = NotFound desc = could not find container \"21d980ee60451c0a4e4732b730e9cb590d88b2d127ff66212dbee8fa836ab292\": container with ID starting with 21d980ee60451c0a4e4732b730e9cb590d88b2d127ff66212dbee8fa836ab292 not found: ID does not exist"
Sep 14 09:45:56.407227 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:56.407185    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67454f647d-7x5tm"]
Sep 14 09:45:56.413340 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:56.413309    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67454f647d-7x5tm"]
Sep 14 09:45:56.654325 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:45:56.654244    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e38a8cf5-4acb-4db7-b813-749473741671" path="/var/lib/kubelet/pods/e38a8cf5-4acb-4db7-b813-749473741671/volumes"
Sep 14 09:46:00.368645 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:46:00.368611    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6zmdn"
Sep 14 09:46:00.403967 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:46:00.403935    2581 generic.go:356] "Generic (PLEG): container finished" podID="bafdd1e7-cf34-4b63-9d55-9f5785b01ea3" containerID="34a7ab8769a02692acc083df7e2f0260c1955c0461d509e976ac15ed978fce7f" exitCode=0
Sep 14 09:46:00.404161 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:46:00.404014    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wnntw" event={"ID":"bafdd1e7-cf34-4b63-9d55-9f5785b01ea3","Type":"ContainerDied","Data":"34a7ab8769a02692acc083df7e2f0260c1955c0461d509e976ac15ed978fce7f"}
Sep 14 09:46:00.404415 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:46:00.404399    2581 scope.go:117] "RemoveContainer" containerID="34a7ab8769a02692acc083df7e2f0260c1955c0461d509e976ac15ed978fce7f"
Sep 14 09:46:01.409238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:46:01.409200    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-wnntw" event={"ID":"bafdd1e7-cf34-4b63-9d55-9f5785b01ea3","Type":"ContainerStarted","Data":"e01e1c77e77dc3b8b2a1dd097dd1b9ca08f34adcc36c712d060ffbb9d72eddf2"}
Sep 14 09:46:05.424896 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:46:05.424857    2581 generic.go:356] "Generic (PLEG): container finished" podID="977c6b7b-d8e8-4b0d-b312-163d6fee715a" containerID="155b01413f65bde4bfef98dbf00347d6aa67fdd02cd9a237357d7dd0260dbd6c" exitCode=0
Sep 14 09:46:05.425308 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:46:05.424914    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-zst5h" event={"ID":"977c6b7b-d8e8-4b0d-b312-163d6fee715a","Type":"ContainerDied","Data":"155b01413f65bde4bfef98dbf00347d6aa67fdd02cd9a237357d7dd0260dbd6c"}
Sep 14 09:46:05.425308 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:46:05.425242    2581 scope.go:117] "RemoveContainer" containerID="155b01413f65bde4bfef98dbf00347d6aa67fdd02cd9a237357d7dd0260dbd6c"
Sep 14 09:46:06.200876 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:46:06.200841    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6zmdn_59ba9674-e083-4b6a-b47b-8bf88d0f926c/dns/0.log"
Sep 14 09:46:06.207494 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:46:06.207466    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6zmdn_59ba9674-e083-4b6a-b47b-8bf88d0f926c/kube-rbac-proxy/0.log"
Sep 14 09:46:06.433079 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:46:06.433046    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-zst5h" event={"ID":"977c6b7b-d8e8-4b0d-b312-163d6fee715a","Type":"ContainerStarted","Data":"aae7c3e3276d7c4fdb413476bae3b8eaf09fcf9369fe482790d398484ea6cb69"}
Sep 14 09:46:06.783358 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:46:06.783331    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k4h57_af3b9fa5-b5eb-41b5-b21f-c3983847fb50/dns-node-resolver/0.log"
Sep 14 09:46:59.548961 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:46:59.548925    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68b9dbf6c7-dqdpq"]
Sep 14 09:47:24.573820 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.573772    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-68b9dbf6c7-dqdpq" podUID="ed757dc5-847d-487b-bd1f-24e5d6411e62" containerName="console" containerID="cri-o://c26f82bcbca2dd529e10166ea149340a4f87eb07bde1e5a7c3413de18ae157a4" gracePeriod=15
Sep 14 09:47:24.725122 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.725086    2581 generic.go:356] "Generic (PLEG): container finished" podID="ed757dc5-847d-487b-bd1f-24e5d6411e62" containerID="c26f82bcbca2dd529e10166ea149340a4f87eb07bde1e5a7c3413de18ae157a4" exitCode=0
Sep 14 09:47:24.725289 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.725162    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68b9dbf6c7-dqdpq" event={"ID":"ed757dc5-847d-487b-bd1f-24e5d6411e62","Type":"ContainerDied","Data":"c26f82bcbca2dd529e10166ea149340a4f87eb07bde1e5a7c3413de18ae157a4"}
Sep 14 09:47:24.818304 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.818275    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:47:24.897670 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.897579    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv4z9\" (UniqueName: \"kubernetes.io/projected/ed757dc5-847d-487b-bd1f-24e5d6411e62-kube-api-access-zv4z9\") pod \"ed757dc5-847d-487b-bd1f-24e5d6411e62\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") "
Sep 14 09:47:24.897670 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.897624    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed757dc5-847d-487b-bd1f-24e5d6411e62-console-oauth-config\") pod \"ed757dc5-847d-487b-bd1f-24e5d6411e62\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") "
Sep 14 09:47:24.897670 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.897666    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-oauth-serving-cert\") pod \"ed757dc5-847d-487b-bd1f-24e5d6411e62\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") "
Sep 14 09:47:24.897969 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.897687    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed757dc5-847d-487b-bd1f-24e5d6411e62-console-serving-cert\") pod \"ed757dc5-847d-487b-bd1f-24e5d6411e62\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") "
Sep 14 09:47:24.897969 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.897738    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-trusted-ca-bundle\") pod \"ed757dc5-847d-487b-bd1f-24e5d6411e62\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") "
Sep 14 09:47:24.897969 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.897766    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-service-ca\") pod \"ed757dc5-847d-487b-bd1f-24e5d6411e62\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") "
Sep 14 09:47:24.897969 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.897795    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-console-config\") pod \"ed757dc5-847d-487b-bd1f-24e5d6411e62\" (UID: \"ed757dc5-847d-487b-bd1f-24e5d6411e62\") "
Sep 14 09:47:24.898335 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.898289    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-console-config" (OuterVolumeSpecName: "console-config") pod "ed757dc5-847d-487b-bd1f-24e5d6411e62" (UID: "ed757dc5-847d-487b-bd1f-24e5d6411e62"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 09:47:24.898335 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.898310    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-service-ca" (OuterVolumeSpecName: "service-ca") pod "ed757dc5-847d-487b-bd1f-24e5d6411e62" (UID: "ed757dc5-847d-487b-bd1f-24e5d6411e62"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 09:47:24.898501 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.898392    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ed757dc5-847d-487b-bd1f-24e5d6411e62" (UID: "ed757dc5-847d-487b-bd1f-24e5d6411e62"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 09:47:24.898501 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.898442    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ed757dc5-847d-487b-bd1f-24e5d6411e62" (UID: "ed757dc5-847d-487b-bd1f-24e5d6411e62"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 09:47:24.900033 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.900004    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed757dc5-847d-487b-bd1f-24e5d6411e62-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ed757dc5-847d-487b-bd1f-24e5d6411e62" (UID: "ed757dc5-847d-487b-bd1f-24e5d6411e62"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 09:47:24.900397 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.900369    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed757dc5-847d-487b-bd1f-24e5d6411e62-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ed757dc5-847d-487b-bd1f-24e5d6411e62" (UID: "ed757dc5-847d-487b-bd1f-24e5d6411e62"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 09:47:24.900501 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.900378    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed757dc5-847d-487b-bd1f-24e5d6411e62-kube-api-access-zv4z9" (OuterVolumeSpecName: "kube-api-access-zv4z9") pod "ed757dc5-847d-487b-bd1f-24e5d6411e62" (UID: "ed757dc5-847d-487b-bd1f-24e5d6411e62"). InnerVolumeSpecName "kube-api-access-zv4z9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 09:47:24.998514 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.998473    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-trusted-ca-bundle\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:47:24.998514 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.998506    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-service-ca\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:47:24.998514 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.998519    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-console-config\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:47:24.998790 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.998531    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv4z9\" (UniqueName: \"kubernetes.io/projected/ed757dc5-847d-487b-bd1f-24e5d6411e62-kube-api-access-zv4z9\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:47:24.998790 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.998545    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed757dc5-847d-487b-bd1f-24e5d6411e62-console-oauth-config\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:47:24.998790 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.998557    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed757dc5-847d-487b-bd1f-24e5d6411e62-oauth-serving-cert\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:47:24.998790 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:24.998568    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed757dc5-847d-487b-bd1f-24e5d6411e62-console-serving-cert\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:47:25.730348 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:25.730312    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68b9dbf6c7-dqdpq" event={"ID":"ed757dc5-847d-487b-bd1f-24e5d6411e62","Type":"ContainerDied","Data":"e1cbbc9a840758e357a694d110181fd25b254e3387d0ba7b80c14368381c483d"}
Sep 14 09:47:25.730348 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:25.730348    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68b9dbf6c7-dqdpq"
Sep 14 09:47:25.730907 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:25.730376    2581 scope.go:117] "RemoveContainer" containerID="c26f82bcbca2dd529e10166ea149340a4f87eb07bde1e5a7c3413de18ae157a4"
Sep 14 09:47:25.752724 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:25.752675    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68b9dbf6c7-dqdpq"]
Sep 14 09:47:25.755081 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:25.755050    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68b9dbf6c7-dqdpq"]
Sep 14 09:47:26.654243 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:47:26.654203    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed757dc5-847d-487b-bd1f-24e5d6411e62" path="/var/lib/kubelet/pods/ed757dc5-847d-487b-bd1f-24e5d6411e62/volumes"
Sep 14 09:48:04.574200 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:04.574171    2581 kubelet.go:1648] "Image garbage collection succeeded"
Sep 14 09:48:42.895548 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:42.895511    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jfz2z"]
Sep 14 09:48:42.897918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:42.895778    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e38a8cf5-4acb-4db7-b813-749473741671" containerName="console"
Sep 14 09:48:42.897918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:42.895791    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e38a8cf5-4acb-4db7-b813-749473741671" containerName="console"
Sep 14 09:48:42.897918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:42.895801    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed757dc5-847d-487b-bd1f-24e5d6411e62" containerName="console"
Sep 14 09:48:42.897918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:42.895808    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed757dc5-847d-487b-bd1f-24e5d6411e62" containerName="console"
Sep 14 09:48:42.897918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:42.895852    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed757dc5-847d-487b-bd1f-24e5d6411e62" containerName="console"
Sep 14 09:48:42.897918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:42.895862    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e38a8cf5-4acb-4db7-b813-749473741671" containerName="console"
Sep 14 09:48:42.898764 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:42.898747    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jfz2z"
Sep 14 09:48:42.901750 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:42.901727    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 14 09:48:42.901885 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:42.901866    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 14 09:48:42.902897 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:42.902877    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-fqd4m\""
Sep 14 09:48:42.908390 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:42.908363    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jfz2z"]
Sep 14 09:48:42.987472 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:42.987429    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqbnv\" (UniqueName: \"kubernetes.io/projected/c7c77041-3a61-4fc1-949f-1347d7ef91ce-kube-api-access-bqbnv\") pod \"cert-manager-cainjector-559cdd8c87-jfz2z\" (UID: \"c7c77041-3a61-4fc1-949f-1347d7ef91ce\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jfz2z"
Sep 14 09:48:42.987637 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:42.987482    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7c77041-3a61-4fc1-949f-1347d7ef91ce-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jfz2z\" (UID: \"c7c77041-3a61-4fc1-949f-1347d7ef91ce\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jfz2z"
Sep 14 09:48:43.088108 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:43.088062    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqbnv\" (UniqueName: \"kubernetes.io/projected/c7c77041-3a61-4fc1-949f-1347d7ef91ce-kube-api-access-bqbnv\") pod \"cert-manager-cainjector-559cdd8c87-jfz2z\" (UID: \"c7c77041-3a61-4fc1-949f-1347d7ef91ce\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jfz2z"
Sep 14 09:48:43.088319 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:43.088121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7c77041-3a61-4fc1-949f-1347d7ef91ce-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jfz2z\" (UID: \"c7c77041-3a61-4fc1-949f-1347d7ef91ce\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jfz2z"
Sep 14 09:48:43.097272 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:43.097235    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7c77041-3a61-4fc1-949f-1347d7ef91ce-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jfz2z\" (UID: \"c7c77041-3a61-4fc1-949f-1347d7ef91ce\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jfz2z"
Sep 14 09:48:43.097419 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:43.097398    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqbnv\" (UniqueName: \"kubernetes.io/projected/c7c77041-3a61-4fc1-949f-1347d7ef91ce-kube-api-access-bqbnv\") pod \"cert-manager-cainjector-559cdd8c87-jfz2z\" (UID: \"c7c77041-3a61-4fc1-949f-1347d7ef91ce\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jfz2z"
Sep 14 09:48:43.208204 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:43.208174    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jfz2z"
Sep 14 09:48:43.480402 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:43.480316    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jfz2z"]
Sep 14 09:48:43.483340 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:48:43.483305    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7c77041_3a61_4fc1_949f_1347d7ef91ce.slice/crio-14c5ef806cb016e6080b18d6b80202259b5184de123ebf4644640d6606328a52 WatchSource:0}: Error finding container 14c5ef806cb016e6080b18d6b80202259b5184de123ebf4644640d6606328a52: Status 404 returned error can't find the container with id 14c5ef806cb016e6080b18d6b80202259b5184de123ebf4644640d6606328a52
Sep 14 09:48:43.485332 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:43.485312    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 09:48:44.009832 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:44.009796    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jfz2z" event={"ID":"c7c77041-3a61-4fc1-949f-1347d7ef91ce","Type":"ContainerStarted","Data":"14c5ef806cb016e6080b18d6b80202259b5184de123ebf4644640d6606328a52"}
Sep 14 09:48:47.022916 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:47.022877    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jfz2z" event={"ID":"c7c77041-3a61-4fc1-949f-1347d7ef91ce","Type":"ContainerStarted","Data":"7076df840c1020737de9812a8de180a0b076783fadc76292a323dd4856d60e6c"}
Sep 14 09:48:47.065914 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:48:47.065852    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jfz2z" podStartSLOduration=2.052770009 podStartE2EDuration="5.065836284s" totalImagesPullingTime="3.013066275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:48:47.064485217 +0000 UTC m=+342.922717598" watchObservedRunningTime="2026-09-14 09:48:47.065836284 +0000 UTC m=+342.924068640"
Sep 14 09:49:21.537821 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.537788    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"]
Sep 14 09:49:21.542169 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.542146    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"
Sep 14 09:49:21.544835 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.544812    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 14 09:49:21.548609 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.548324    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 14 09:49:21.548609 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.548368    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 14 09:49:21.548609 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.548368    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 14 09:49:21.548774 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.548726    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n4vsj\""
Sep 14 09:49:21.559507 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.559484    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"]
Sep 14 09:49:21.573073 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.573049    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrfll\" (UniqueName: \"kubernetes.io/projected/11191c17-2403-4f1a-a5b6-b9ae9fbd965f-kube-api-access-nrfll\") pod \"opendatahub-operator-controller-manager-84fdd9869c-5t7b9\" (UID: \"11191c17-2403-4f1a-a5b6-b9ae9fbd965f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"
Sep 14 09:49:21.573190 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.573087    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/11191c17-2403-4f1a-a5b6-b9ae9fbd965f-manifests\") pod \"opendatahub-operator-controller-manager-84fdd9869c-5t7b9\" (UID: \"11191c17-2403-4f1a-a5b6-b9ae9fbd965f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"
Sep 14 09:49:21.573190 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.573104    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/11191c17-2403-4f1a-a5b6-b9ae9fbd965f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84fdd9869c-5t7b9\" (UID: \"11191c17-2403-4f1a-a5b6-b9ae9fbd965f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"
Sep 14 09:49:21.573190 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.573159    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11191c17-2403-4f1a-a5b6-b9ae9fbd965f-webhook-cert\") pod \"opendatahub-operator-controller-manager-84fdd9869c-5t7b9\" (UID: \"11191c17-2403-4f1a-a5b6-b9ae9fbd965f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"
Sep 14 09:49:21.573190 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.573177    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11191c17-2403-4f1a-a5b6-b9ae9fbd965f-tmp\") pod \"opendatahub-operator-controller-manager-84fdd9869c-5t7b9\" (UID: \"11191c17-2403-4f1a-a5b6-b9ae9fbd965f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"
Sep 14 09:49:21.674321 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.674282    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrfll\" (UniqueName: \"kubernetes.io/projected/11191c17-2403-4f1a-a5b6-b9ae9fbd965f-kube-api-access-nrfll\") pod \"opendatahub-operator-controller-manager-84fdd9869c-5t7b9\" (UID: \"11191c17-2403-4f1a-a5b6-b9ae9fbd965f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"
Sep 14 09:49:21.674494 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.674335    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/11191c17-2403-4f1a-a5b6-b9ae9fbd965f-manifests\") pod \"opendatahub-operator-controller-manager-84fdd9869c-5t7b9\" (UID: \"11191c17-2403-4f1a-a5b6-b9ae9fbd965f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"
Sep 14 09:49:21.674494 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.674359    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/11191c17-2403-4f1a-a5b6-b9ae9fbd965f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84fdd9869c-5t7b9\" (UID: \"11191c17-2403-4f1a-a5b6-b9ae9fbd965f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"
Sep 14 09:49:21.674494 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.674410    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11191c17-2403-4f1a-a5b6-b9ae9fbd965f-webhook-cert\") pod \"opendatahub-operator-controller-manager-84fdd9869c-5t7b9\" (UID: \"11191c17-2403-4f1a-a5b6-b9ae9fbd965f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"
Sep 14 09:49:21.674494 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.674440    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11191c17-2403-4f1a-a5b6-b9ae9fbd965f-tmp\") pod \"opendatahub-operator-controller-manager-84fdd9869c-5t7b9\" (UID: \"11191c17-2403-4f1a-a5b6-b9ae9fbd965f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"
Sep 14 09:49:21.674747 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.674691    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/11191c17-2403-4f1a-a5b6-b9ae9fbd965f-manifests\") pod \"opendatahub-operator-controller-manager-84fdd9869c-5t7b9\" (UID: \"11191c17-2403-4f1a-a5b6-b9ae9fbd965f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"
Sep 14 09:49:21.676873 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.676836    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11191c17-2403-4f1a-a5b6-b9ae9fbd965f-tmp\") pod \"opendatahub-operator-controller-manager-84fdd9869c-5t7b9\" (UID: \"11191c17-2403-4f1a-a5b6-b9ae9fbd965f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"
Sep 14 09:49:21.677084 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.677066    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11191c17-2403-4f1a-a5b6-b9ae9fbd965f-webhook-cert\") pod \"opendatahub-operator-controller-manager-84fdd9869c-5t7b9\" (UID: \"11191c17-2403-4f1a-a5b6-b9ae9fbd965f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"
Sep 14 09:49:21.677186 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.677163    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/11191c17-2403-4f1a-a5b6-b9ae9fbd965f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84fdd9869c-5t7b9\" (UID: \"11191c17-2403-4f1a-a5b6-b9ae9fbd965f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"
Sep 14 09:49:21.700796 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.700763    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrfll\" (UniqueName: \"kubernetes.io/projected/11191c17-2403-4f1a-a5b6-b9ae9fbd965f-kube-api-access-nrfll\") pod \"opendatahub-operator-controller-manager-84fdd9869c-5t7b9\" (UID: \"11191c17-2403-4f1a-a5b6-b9ae9fbd965f\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"
Sep 14 09:49:21.852068 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:21.851940    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"
Sep 14 09:49:22.131082 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:22.131056    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"]
Sep 14 09:49:22.133955 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:49:22.133924    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11191c17_2403_4f1a_a5b6_b9ae9fbd965f.slice/crio-ed0ab5a451bef29cb8d37fde6e6ff0ad29e8df94505711c10184a6a9ebc81c55 WatchSource:0}: Error finding container ed0ab5a451bef29cb8d37fde6e6ff0ad29e8df94505711c10184a6a9ebc81c55: Status 404 returned error can't find the container with id ed0ab5a451bef29cb8d37fde6e6ff0ad29e8df94505711c10184a6a9ebc81c55
Sep 14 09:49:22.148938 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:22.148896    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9" event={"ID":"11191c17-2403-4f1a-a5b6-b9ae9fbd965f","Type":"ContainerStarted","Data":"ed0ab5a451bef29cb8d37fde6e6ff0ad29e8df94505711c10184a6a9ebc81c55"}
Sep 14 09:49:25.161896 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:25.161863    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9" event={"ID":"11191c17-2403-4f1a-a5b6-b9ae9fbd965f","Type":"ContainerStarted","Data":"99cc551ed9dfe9b94f36e5a6ec07d2ac424de86a43e4a8f221e4ad0024e238ca"}
Sep 14 09:49:27.174610 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:27.174535    2581 generic.go:356] "Generic (PLEG): container finished" podID="11191c17-2403-4f1a-a5b6-b9ae9fbd965f" containerID="99cc551ed9dfe9b94f36e5a6ec07d2ac424de86a43e4a8f221e4ad0024e238ca" exitCode=0
Sep 14 09:49:27.175454 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:27.174617    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9" event={"ID":"11191c17-2403-4f1a-a5b6-b9ae9fbd965f","Type":"ContainerDied","Data":"99cc551ed9dfe9b94f36e5a6ec07d2ac424de86a43e4a8f221e4ad0024e238ca"}
Sep 14 09:49:28.179982 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:28.179950    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9" event={"ID":"11191c17-2403-4f1a-a5b6-b9ae9fbd965f","Type":"ContainerStarted","Data":"6af7d6d1a312e48bb7304b619e03100d6eef6e1884a3ea765914300774484b5c"}
Sep 14 09:49:28.180366 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:28.180165    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"
Sep 14 09:49:28.205885 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:28.205828    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9" podStartSLOduration=2.8168424290000003 podStartE2EDuration="7.205810998s" totalImagesPullingTime="3.339990153s" totalInitContainerRuntime="1.048978416s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:49:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:49:28.205074323 +0000 UTC m=+384.063306678" watchObservedRunningTime="2026-09-14 09:49:28.205810998 +0000 UTC m=+384.064043424"
Sep 14 09:49:39.186347 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:39.186316    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-84fdd9869c-5t7b9"
Sep 14 09:49:41.649663 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:41.649618    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65d9bcd789-cl6d4"]
Sep 14 09:49:41.658181 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:41.658153    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65d9bcd789-cl6d4"
Sep 14 09:49:41.662627 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:41.662601    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 14 09:49:41.662800 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:41.662601    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-x6wrj\""
Sep 14 09:49:41.662800 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:41.662601    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 14 09:49:41.665965 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:41.665937    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65d9bcd789-cl6d4"]
Sep 14 09:49:41.733793 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:41.733747    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942-tmp\") pod \"kube-auth-proxy-65d9bcd789-cl6d4\" (UID: \"12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942\") " pod="openshift-ingress/kube-auth-proxy-65d9bcd789-cl6d4"
Sep 14 09:49:41.733986 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:41.733845    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chksc\" (UniqueName: \"kubernetes.io/projected/12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942-kube-api-access-chksc\") pod \"kube-auth-proxy-65d9bcd789-cl6d4\" (UID: \"12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942\") " pod="openshift-ingress/kube-auth-proxy-65d9bcd789-cl6d4"
Sep 14 09:49:41.733986 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:41.733876    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942-tls-certs\") pod \"kube-auth-proxy-65d9bcd789-cl6d4\" (UID: \"12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942\") " pod="openshift-ingress/kube-auth-proxy-65d9bcd789-cl6d4"
Sep 14 09:49:41.834932 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:41.834880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942-tmp\") pod \"kube-auth-proxy-65d9bcd789-cl6d4\" (UID: \"12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942\") " pod="openshift-ingress/kube-auth-proxy-65d9bcd789-cl6d4"
Sep 14 09:49:41.834932 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:41.834945    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chksc\" (UniqueName: \"kubernetes.io/projected/12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942-kube-api-access-chksc\") pod \"kube-auth-proxy-65d9bcd789-cl6d4\" (UID: \"12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942\") " pod="openshift-ingress/kube-auth-proxy-65d9bcd789-cl6d4"
Sep 14 09:49:41.835145 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:41.834976    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942-tls-certs\") pod \"kube-auth-proxy-65d9bcd789-cl6d4\" (UID: \"12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942\") " pod="openshift-ingress/kube-auth-proxy-65d9bcd789-cl6d4"
Sep 14 09:49:41.837226 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:41.837200    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942-tmp\") pod \"kube-auth-proxy-65d9bcd789-cl6d4\" (UID: \"12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942\") " pod="openshift-ingress/kube-auth-proxy-65d9bcd789-cl6d4"
Sep 14 09:49:41.837341 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:41.837328    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942-tls-certs\") pod \"kube-auth-proxy-65d9bcd789-cl6d4\" (UID: \"12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942\") " pod="openshift-ingress/kube-auth-proxy-65d9bcd789-cl6d4"
Sep 14 09:49:41.845583 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:41.845504    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chksc\" (UniqueName: \"kubernetes.io/projected/12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942-kube-api-access-chksc\") pod \"kube-auth-proxy-65d9bcd789-cl6d4\" (UID: \"12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942\") " pod="openshift-ingress/kube-auth-proxy-65d9bcd789-cl6d4"
Sep 14 09:49:41.967819 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:41.967786    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65d9bcd789-cl6d4"
Sep 14 09:49:42.250801 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:42.250723    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65d9bcd789-cl6d4"]
Sep 14 09:49:42.255831 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:49:42.255806    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c9b3fe_aaf8_4f7c_bfe8_1afb6b57a942.slice/crio-48efd9dba23a91ea8e94020d175beb502002804930d1aa03dcf4f45814a1eebd WatchSource:0}: Error finding container 48efd9dba23a91ea8e94020d175beb502002804930d1aa03dcf4f45814a1eebd: Status 404 returned error can't find the container with id 48efd9dba23a91ea8e94020d175beb502002804930d1aa03dcf4f45814a1eebd
Sep 14 09:49:43.202029 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.201986    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"]
Sep 14 09:49:43.204496 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.204465    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.209924 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.209889    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 14 09:49:43.210062 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.210017    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-j8c6s\""
Sep 14 09:49:43.210130 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.210113    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 14 09:49:43.210226 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.210203    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 14 09:49:43.210346 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.210320    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 14 09:49:43.230776 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.230740    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"]
Sep 14 09:49:43.239730 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.239646    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65d9bcd789-cl6d4" event={"ID":"12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942","Type":"ContainerStarted","Data":"48efd9dba23a91ea8e94020d175beb502002804930d1aa03dcf4f45814a1eebd"}
Sep 14 09:49:43.347365 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.347325    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-4strh\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.347571 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.347396    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-4strh\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.347571 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.347433    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfpv6\" (UniqueName: \"kubernetes.io/projected/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-kube-api-access-xfpv6\") pod \"istiod-openshift-gateway-7b7995d5cd-4strh\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.347571 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.347462    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-4strh\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.347571 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.347502    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-4strh\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.347571 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.347542    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-4strh\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.347571 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.347567    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-4strh\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.449135 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.448979    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-4strh\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.449135 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.449033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-4strh\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.449135 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.449091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-4strh\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.449135 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.449140    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-4strh\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.449487 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.449163    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfpv6\" (UniqueName: \"kubernetes.io/projected/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-kube-api-access-xfpv6\") pod \"istiod-openshift-gateway-7b7995d5cd-4strh\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.449487 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.449187    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-4strh\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.449487 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.449226    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-4strh\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.449848 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.449820    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-4strh\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.452193 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.452111    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-4strh\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.452595 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.452537    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-4strh\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.452595 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.452543    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-4strh\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.453565 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.453525    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-4strh\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.466005 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.465979    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-4strh\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.467562 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.467532    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfpv6\" (UniqueName: \"kubernetes.io/projected/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-kube-api-access-xfpv6\") pod \"istiod-openshift-gateway-7b7995d5cd-4strh\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:43.518207 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:43.518163    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:45.106438 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:45.106416    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"]
Sep 14 09:49:45.108559 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:49:45.108529    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d7104f2_f9ef_40d0_a5b8_64c21140f7e0.slice/crio-e1bb12531865331e21b9807ea21c7e71cea4c47cd1ca97fe499e91a8e8fd91ca WatchSource:0}: Error finding container e1bb12531865331e21b9807ea21c7e71cea4c47cd1ca97fe499e91a8e8fd91ca: Status 404 returned error can't find the container with id e1bb12531865331e21b9807ea21c7e71cea4c47cd1ca97fe499e91a8e8fd91ca
Sep 14 09:49:45.250157 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:45.250120    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh" event={"ID":"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0","Type":"ContainerStarted","Data":"e1bb12531865331e21b9807ea21c7e71cea4c47cd1ca97fe499e91a8e8fd91ca"}
Sep 14 09:49:45.251483 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:45.251452    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65d9bcd789-cl6d4" event={"ID":"12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942","Type":"ContainerStarted","Data":"a69c81bab91d19bbe151c35362d9740fc488a82ce140261091ce07c4d5239b7b"}
Sep 14 09:49:45.276692 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:45.276644    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65d9bcd789-cl6d4" podStartSLOduration=1.641026905 podStartE2EDuration="4.276627484s" totalImagesPullingTime="2.635600579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:49:45.276540843 +0000 UTC m=+401.134773228" watchObservedRunningTime="2026-09-14 09:49:45.276627484 +0000 UTC m=+401.134859841"
Sep 14 09:49:47.489482 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:47.489446    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 09:49:47.489767 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:47.489509    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 09:49:48.265928 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:48.265879    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh" event={"ID":"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0","Type":"ContainerStarted","Data":"1b02c0cfd36d94ead1342db8f114349f6c85de3b4cbb165a74cc0aaa4e4a790a"}
Sep 14 09:49:48.266112 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:48.265988    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:48.267821 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:48.267789    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-4strh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 14 09:49:48.267940 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:48.267852    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh" podUID="0d7104f2-f9ef-40d0-a5b8-64c21140f7e0" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 14 09:49:49.271916 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:49.271887    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:49:49.295153 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:49:49.295099    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh" podStartSLOduration=3.9164386799999997 podStartE2EDuration="6.295082416s" totalImagesPullingTime="2.378643736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:49:48.291889887 +0000 UTC m=+404.150122244" watchObservedRunningTime="2026-09-14 09:49:49.295082416 +0000 UTC m=+405.153314772"
Sep 14 09:50:02.504598 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:02.504553    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5dqmt"]
Sep 14 09:50:02.507815 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:02.507779    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5dqmt"
Sep 14 09:50:02.511535 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:02.511498    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 14 09:50:02.511535 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:02.511525    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-g2gn6\""
Sep 14 09:50:02.516497 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:02.516461    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-tzmc6"]
Sep 14 09:50:02.519653 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:02.519624    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tzmc6"
Sep 14 09:50:02.530876 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:02.530838    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-hndpd\""
Sep 14 09:50:02.531195 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:02.531165    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 14 09:50:02.532295 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:02.532264    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5dqmt"]
Sep 14 09:50:02.535756 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:02.535703    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-tzmc6"]
Sep 14 09:50:02.607625 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:02.607582    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aece210a-f788-4bdc-9ee6-b59b5efb7ce4-cert\") pod \"kserve-controller-manager-d6f4b65b8-5dqmt\" (UID: \"aece210a-f788-4bdc-9ee6-b59b5efb7ce4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5dqmt"
Sep 14 09:50:02.607841 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:02.607638    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f23217c7-4cdb-421e-94c9-83774066aed7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-tzmc6\" (UID: \"f23217c7-4cdb-421e-94c9-83774066aed7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tzmc6"
Sep 14 09:50:02.607841 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:02.607764    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd9c8\" (UniqueName: \"kubernetes.io/projected/f23217c7-4cdb-421e-94c9-83774066aed7-kube-api-access-gd9c8\") pod \"llmisvc-controller-manager-777c6bd7d5-tzmc6\" (UID: \"f23217c7-4cdb-421e-94c9-83774066aed7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tzmc6"
Sep 14 09:50:02.607841 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:02.607810    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl472\" (UniqueName: \"kubernetes.io/projected/aece210a-f788-4bdc-9ee6-b59b5efb7ce4-kube-api-access-dl472\") pod \"kserve-controller-manager-d6f4b65b8-5dqmt\" (UID: \"aece210a-f788-4bdc-9ee6-b59b5efb7ce4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5dqmt"
Sep 14 09:50:02.709114 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:02.709075    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aece210a-f788-4bdc-9ee6-b59b5efb7ce4-cert\") pod \"kserve-controller-manager-d6f4b65b8-5dqmt\" (UID: \"aece210a-f788-4bdc-9ee6-b59b5efb7ce4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5dqmt"
Sep 14 09:50:02.709290 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:02.709122    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f23217c7-4cdb-421e-94c9-83774066aed7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-tzmc6\" (UID: \"f23217c7-4cdb-421e-94c9-83774066aed7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tzmc6"
Sep 14 09:50:02.709290 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:02.709156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd9c8\" (UniqueName: \"kubernetes.io/projected/f23217c7-4cdb-421e-94c9-83774066aed7-kube-api-access-gd9c8\") pod \"llmisvc-controller-manager-777c6bd7d5-tzmc6\" (UID: \"f23217c7-4cdb-421e-94c9-83774066aed7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tzmc6"
Sep 14 09:50:02.709290 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:02.709178    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl472\" (UniqueName: \"kubernetes.io/projected/aece210a-f788-4bdc-9ee6-b59b5efb7ce4-kube-api-access-dl472\") pod \"kserve-controller-manager-d6f4b65b8-5dqmt\" (UID: \"aece210a-f788-4bdc-9ee6-b59b5efb7ce4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5dqmt"
Sep 14 09:50:02.709290 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:50:02.709230    2581 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 14 09:50:02.709491 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:50:02.709304    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aece210a-f788-4bdc-9ee6-b59b5efb7ce4-cert podName:aece210a-f788-4bdc-9ee6-b59b5efb7ce4 nodeName:}" failed. No retries permitted until 2026-09-14 09:50:03.209287812 +0000 UTC m=+419.067520146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/aece210a-f788-4bdc-9ee6-b59b5efb7ce4-cert") pod "kserve-controller-manager-d6f4b65b8-5dqmt" (UID: "aece210a-f788-4bdc-9ee6-b59b5efb7ce4") : secret "kserve-webhook-server-cert" not found
Sep 14 09:50:02.709491 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:50:02.709368    2581 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 14 09:50:02.709491 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:50:02.709443    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f23217c7-4cdb-421e-94c9-83774066aed7-cert podName:f23217c7-4cdb-421e-94c9-83774066aed7 nodeName:}" failed. No retries permitted until 2026-09-14 09:50:03.209424634 +0000 UTC m=+419.067656968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f23217c7-4cdb-421e-94c9-83774066aed7-cert") pod "llmisvc-controller-manager-777c6bd7d5-tzmc6" (UID: "f23217c7-4cdb-421e-94c9-83774066aed7") : secret "llmisvc-webhook-server-cert" not found
Sep 14 09:50:02.735024 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:02.734989    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl472\" (UniqueName: \"kubernetes.io/projected/aece210a-f788-4bdc-9ee6-b59b5efb7ce4-kube-api-access-dl472\") pod \"kserve-controller-manager-d6f4b65b8-5dqmt\" (UID: \"aece210a-f788-4bdc-9ee6-b59b5efb7ce4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5dqmt"
Sep 14 09:50:02.735648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:02.735627    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd9c8\" (UniqueName: \"kubernetes.io/projected/f23217c7-4cdb-421e-94c9-83774066aed7-kube-api-access-gd9c8\") pod \"llmisvc-controller-manager-777c6bd7d5-tzmc6\" (UID: \"f23217c7-4cdb-421e-94c9-83774066aed7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tzmc6"
Sep 14 09:50:03.213665 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:03.213619    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f23217c7-4cdb-421e-94c9-83774066aed7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-tzmc6\" (UID: \"f23217c7-4cdb-421e-94c9-83774066aed7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tzmc6"
Sep 14 09:50:03.213871 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:03.213746    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aece210a-f788-4bdc-9ee6-b59b5efb7ce4-cert\") pod \"kserve-controller-manager-d6f4b65b8-5dqmt\" (UID: \"aece210a-f788-4bdc-9ee6-b59b5efb7ce4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5dqmt"
Sep 14 09:50:03.216243 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:03.216216    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f23217c7-4cdb-421e-94c9-83774066aed7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-tzmc6\" (UID: \"f23217c7-4cdb-421e-94c9-83774066aed7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tzmc6"
Sep 14 09:50:03.216352 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:03.216216    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aece210a-f788-4bdc-9ee6-b59b5efb7ce4-cert\") pod \"kserve-controller-manager-d6f4b65b8-5dqmt\" (UID: \"aece210a-f788-4bdc-9ee6-b59b5efb7ce4\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-5dqmt"
Sep 14 09:50:03.420280 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:03.420246    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5dqmt"
Sep 14 09:50:03.432641 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:03.432610    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tzmc6"
Sep 14 09:50:03.696969 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:03.696945    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-5dqmt"]
Sep 14 09:50:03.699034 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:50:03.699003    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaece210a_f788_4bdc_9ee6_b59b5efb7ce4.slice/crio-d5230cb8ae52860ad9b31641b55a63d3c2c1c171fea20fc3f7e10fa2a04323d7 WatchSource:0}: Error finding container d5230cb8ae52860ad9b31641b55a63d3c2c1c171fea20fc3f7e10fa2a04323d7: Status 404 returned error can't find the container with id d5230cb8ae52860ad9b31641b55a63d3c2c1c171fea20fc3f7e10fa2a04323d7
Sep 14 09:50:03.715347 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:03.715325    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-tzmc6"]
Sep 14 09:50:03.717051 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:50:03.717026    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf23217c7_4cdb_421e_94c9_83774066aed7.slice/crio-6141a14b9103fc0d98f9d37decc05d8efe45aa243f270c495889ee2124828327 WatchSource:0}: Error finding container 6141a14b9103fc0d98f9d37decc05d8efe45aa243f270c495889ee2124828327: Status 404 returned error can't find the container with id 6141a14b9103fc0d98f9d37decc05d8efe45aa243f270c495889ee2124828327
Sep 14 09:50:04.331817 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:04.331780    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5dqmt" event={"ID":"aece210a-f788-4bdc-9ee6-b59b5efb7ce4","Type":"ContainerStarted","Data":"d5230cb8ae52860ad9b31641b55a63d3c2c1c171fea20fc3f7e10fa2a04323d7"}
Sep 14 09:50:04.332945 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:04.332919    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tzmc6" event={"ID":"f23217c7-4cdb-421e-94c9-83774066aed7","Type":"ContainerStarted","Data":"6141a14b9103fc0d98f9d37decc05d8efe45aa243f270c495889ee2124828327"}
Sep 14 09:50:04.738056 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:04.738017    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"]
Sep 14 09:50:04.738485 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:04.738282    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh" podUID="0d7104f2-f9ef-40d0-a5b8-64c21140f7e0" containerName="discovery" containerID="cri-o://1b02c0cfd36d94ead1342db8f114349f6c85de3b4cbb165a74cc0aaa4e4a790a" gracePeriod=30
Sep 14 09:50:05.066993 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.066949    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:50:05.231965 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.231918    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-csr-dns-cert\") pod \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") "
Sep 14 09:50:05.231965 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.231967    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-cacerts\") pod \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") "
Sep 14 09:50:05.232242 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.231992    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-token\") pod \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") "
Sep 14 09:50:05.232242 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.232035    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-local-certs\") pod \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") "
Sep 14 09:50:05.232242 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.232073    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-csr-ca-configmap\") pod \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") "
Sep 14 09:50:05.232242 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.232119    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-kubeconfig\") pod \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") "
Sep 14 09:50:05.232242 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.232152    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfpv6\" (UniqueName: \"kubernetes.io/projected/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-kube-api-access-xfpv6\") pod \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\" (UID: \"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0\") "
Sep 14 09:50:05.232799 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.232759    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "0d7104f2-f9ef-40d0-a5b8-64c21140f7e0" (UID: "0d7104f2-f9ef-40d0-a5b8-64c21140f7e0"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 09:50:05.234800 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.234755    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "0d7104f2-f9ef-40d0-a5b8-64c21140f7e0" (UID: "0d7104f2-f9ef-40d0-a5b8-64c21140f7e0"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 09:50:05.234911 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.234864    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "0d7104f2-f9ef-40d0-a5b8-64c21140f7e0" (UID: "0d7104f2-f9ef-40d0-a5b8-64c21140f7e0"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 09:50:05.234980 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.234951    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-token" (OuterVolumeSpecName: "istio-token") pod "0d7104f2-f9ef-40d0-a5b8-64c21140f7e0" (UID: "0d7104f2-f9ef-40d0-a5b8-64c21140f7e0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 09:50:05.235182 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.235151    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-cacerts" (OuterVolumeSpecName: "cacerts") pod "0d7104f2-f9ef-40d0-a5b8-64c21140f7e0" (UID: "0d7104f2-f9ef-40d0-a5b8-64c21140f7e0"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 09:50:05.235182 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.235149    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-kube-api-access-xfpv6" (OuterVolumeSpecName: "kube-api-access-xfpv6") pod "0d7104f2-f9ef-40d0-a5b8-64c21140f7e0" (UID: "0d7104f2-f9ef-40d0-a5b8-64c21140f7e0"). InnerVolumeSpecName "kube-api-access-xfpv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 09:50:05.235335 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.235307    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-local-certs" (OuterVolumeSpecName: "local-certs") pod "0d7104f2-f9ef-40d0-a5b8-64c21140f7e0" (UID: "0d7104f2-f9ef-40d0-a5b8-64c21140f7e0"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 09:50:05.332991 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.332911    2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-kubeconfig\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:50:05.332991 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.332942    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfpv6\" (UniqueName: \"kubernetes.io/projected/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-kube-api-access-xfpv6\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:50:05.332991 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.332952    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-csr-dns-cert\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:50:05.332991 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.332961    2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-cacerts\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:50:05.332991 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.332970    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-token\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:50:05.332991 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.332980    2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-local-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:50:05.332991 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.332988    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0-istio-csr-ca-configmap\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:50:05.339100 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.339058    2581 generic.go:356] "Generic (PLEG): container finished" podID="0d7104f2-f9ef-40d0-a5b8-64c21140f7e0" containerID="1b02c0cfd36d94ead1342db8f114349f6c85de3b4cbb165a74cc0aaa4e4a790a" exitCode=0
Sep 14 09:50:05.339282 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.339115    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"
Sep 14 09:50:05.339282 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.339132    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh" event={"ID":"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0","Type":"ContainerDied","Data":"1b02c0cfd36d94ead1342db8f114349f6c85de3b4cbb165a74cc0aaa4e4a790a"}
Sep 14 09:50:05.339282 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.339184    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh" event={"ID":"0d7104f2-f9ef-40d0-a5b8-64c21140f7e0","Type":"ContainerDied","Data":"e1bb12531865331e21b9807ea21c7e71cea4c47cd1ca97fe499e91a8e8fd91ca"}
Sep 14 09:50:05.339282 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.339213    2581 scope.go:117] "RemoveContainer" containerID="1b02c0cfd36d94ead1342db8f114349f6c85de3b4cbb165a74cc0aaa4e4a790a"
Sep 14 09:50:05.401357 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.401307    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"]
Sep 14 09:50:05.413759 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.413694    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4strh"]
Sep 14 09:50:05.450005 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.449962    2581 scope.go:117] "RemoveContainer" containerID="1b02c0cfd36d94ead1342db8f114349f6c85de3b4cbb165a74cc0aaa4e4a790a"
Sep 14 09:50:05.450501 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:50:05.450474    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b02c0cfd36d94ead1342db8f114349f6c85de3b4cbb165a74cc0aaa4e4a790a\": container with ID starting with 1b02c0cfd36d94ead1342db8f114349f6c85de3b4cbb165a74cc0aaa4e4a790a not found: ID does not exist" containerID="1b02c0cfd36d94ead1342db8f114349f6c85de3b4cbb165a74cc0aaa4e4a790a"
Sep 14 09:50:05.450637 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:05.450516    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b02c0cfd36d94ead1342db8f114349f6c85de3b4cbb165a74cc0aaa4e4a790a"} err="failed to get container status \"1b02c0cfd36d94ead1342db8f114349f6c85de3b4cbb165a74cc0aaa4e4a790a\": rpc error: code = NotFound desc = could not find container \"1b02c0cfd36d94ead1342db8f114349f6c85de3b4cbb165a74cc0aaa4e4a790a\": container with ID starting with 1b02c0cfd36d94ead1342db8f114349f6c85de3b4cbb165a74cc0aaa4e4a790a not found: ID does not exist"
Sep 14 09:50:06.656629 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:06.656537    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d7104f2-f9ef-40d0-a5b8-64c21140f7e0" path="/var/lib/kubelet/pods/0d7104f2-f9ef-40d0-a5b8-64c21140f7e0/volumes"
Sep 14 09:50:07.353559 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:07.353411    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5dqmt" event={"ID":"aece210a-f788-4bdc-9ee6-b59b5efb7ce4","Type":"ContainerStarted","Data":"c80db947ce2383090d2dddffb93a8a152b9ce78120d7554d28fc27bf1488628a"}
Sep 14 09:50:07.353815 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:07.353561    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5dqmt"
Sep 14 09:50:07.355235 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:07.355201    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tzmc6" event={"ID":"f23217c7-4cdb-421e-94c9-83774066aed7","Type":"ContainerStarted","Data":"2f7ad72db66927551df30f2897fee253d452424099e4fb5219b4c09620554a98"}
Sep 14 09:50:07.355386 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:07.355304    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tzmc6"
Sep 14 09:50:07.373930 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:07.373869    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5dqmt" podStartSLOduration=2.710782442 podStartE2EDuration="5.373847928s" totalImagesPullingTime="2.663065486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:50:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:50:07.373585067 +0000 UTC m=+423.231817452" watchObservedRunningTime="2026-09-14 09:50:07.373847928 +0000 UTC m=+423.232080299"
Sep 14 09:50:07.398411 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:07.398354    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tzmc6" podStartSLOduration=2.034656942 podStartE2EDuration="5.398334954s" totalImagesPullingTime="3.363678012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:50:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:50:07.397416925 +0000 UTC m=+423.255649282" watchObservedRunningTime="2026-09-14 09:50:07.398334954 +0000 UTC m=+423.256567309"
Sep 14 09:50:09.727514 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.727469    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f9d4ddc7f-sr876"]
Sep 14 09:50:09.727945 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.727844    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d7104f2-f9ef-40d0-a5b8-64c21140f7e0" containerName="discovery"
Sep 14 09:50:09.727945 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.727859    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d7104f2-f9ef-40d0-a5b8-64c21140f7e0" containerName="discovery"
Sep 14 09:50:09.727945 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.727906    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d7104f2-f9ef-40d0-a5b8-64c21140f7e0" containerName="discovery"
Sep 14 09:50:09.730641 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.730622    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:09.736967 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.736938    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 14 09:50:09.737122 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.736937    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 14 09:50:09.737122 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.736938    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-stffz\""
Sep 14 09:50:09.737315 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.737261    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 14 09:50:09.737401 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.737339    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 14 09:50:09.737829 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.737451    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 14 09:50:09.737905 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.737886    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 14 09:50:09.737966 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.737945    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 14 09:50:09.744143 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.744116    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 14 09:50:09.744250 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.744195    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f9d4ddc7f-sr876"]
Sep 14 09:50:09.870168 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.870125    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfgt7\" (UniqueName: \"kubernetes.io/projected/1e6180cf-888b-49fa-9c60-121d596a979e-kube-api-access-jfgt7\") pod \"console-7f9d4ddc7f-sr876\" (UID: \"1e6180cf-888b-49fa-9c60-121d596a979e\") " pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:09.870168 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.870178    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e6180cf-888b-49fa-9c60-121d596a979e-oauth-serving-cert\") pod \"console-7f9d4ddc7f-sr876\" (UID: \"1e6180cf-888b-49fa-9c60-121d596a979e\") " pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:09.870374 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.870203    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e6180cf-888b-49fa-9c60-121d596a979e-console-config\") pod \"console-7f9d4ddc7f-sr876\" (UID: \"1e6180cf-888b-49fa-9c60-121d596a979e\") " pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:09.870374 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.870286    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e6180cf-888b-49fa-9c60-121d596a979e-console-serving-cert\") pod \"console-7f9d4ddc7f-sr876\" (UID: \"1e6180cf-888b-49fa-9c60-121d596a979e\") " pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:09.870374 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.870305    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e6180cf-888b-49fa-9c60-121d596a979e-service-ca\") pod \"console-7f9d4ddc7f-sr876\" (UID: \"1e6180cf-888b-49fa-9c60-121d596a979e\") " pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:09.870374 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.870321    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e6180cf-888b-49fa-9c60-121d596a979e-trusted-ca-bundle\") pod \"console-7f9d4ddc7f-sr876\" (UID: \"1e6180cf-888b-49fa-9c60-121d596a979e\") " pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:09.870374 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.870340    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e6180cf-888b-49fa-9c60-121d596a979e-console-oauth-config\") pod \"console-7f9d4ddc7f-sr876\" (UID: \"1e6180cf-888b-49fa-9c60-121d596a979e\") " pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:09.971302 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.971265    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e6180cf-888b-49fa-9c60-121d596a979e-console-serving-cert\") pod \"console-7f9d4ddc7f-sr876\" (UID: \"1e6180cf-888b-49fa-9c60-121d596a979e\") " pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:09.971302 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.971302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e6180cf-888b-49fa-9c60-121d596a979e-service-ca\") pod \"console-7f9d4ddc7f-sr876\" (UID: \"1e6180cf-888b-49fa-9c60-121d596a979e\") " pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:09.971539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.971316    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e6180cf-888b-49fa-9c60-121d596a979e-trusted-ca-bundle\") pod \"console-7f9d4ddc7f-sr876\" (UID: \"1e6180cf-888b-49fa-9c60-121d596a979e\") " pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:09.971539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.971333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e6180cf-888b-49fa-9c60-121d596a979e-console-oauth-config\") pod \"console-7f9d4ddc7f-sr876\" (UID: \"1e6180cf-888b-49fa-9c60-121d596a979e\") " pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:09.971539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.971349    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfgt7\" (UniqueName: \"kubernetes.io/projected/1e6180cf-888b-49fa-9c60-121d596a979e-kube-api-access-jfgt7\") pod \"console-7f9d4ddc7f-sr876\" (UID: \"1e6180cf-888b-49fa-9c60-121d596a979e\") " pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:09.971539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.971373    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e6180cf-888b-49fa-9c60-121d596a979e-oauth-serving-cert\") pod \"console-7f9d4ddc7f-sr876\" (UID: \"1e6180cf-888b-49fa-9c60-121d596a979e\") " pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:09.971539 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.971437    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e6180cf-888b-49fa-9c60-121d596a979e-console-config\") pod \"console-7f9d4ddc7f-sr876\" (UID: \"1e6180cf-888b-49fa-9c60-121d596a979e\") " pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:09.972184 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.972157    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e6180cf-888b-49fa-9c60-121d596a979e-service-ca\") pod \"console-7f9d4ddc7f-sr876\" (UID: \"1e6180cf-888b-49fa-9c60-121d596a979e\") " pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:09.972184 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.972178    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e6180cf-888b-49fa-9c60-121d596a979e-oauth-serving-cert\") pod \"console-7f9d4ddc7f-sr876\" (UID: \"1e6180cf-888b-49fa-9c60-121d596a979e\") " pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:09.972470 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.972444    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e6180cf-888b-49fa-9c60-121d596a979e-console-config\") pod \"console-7f9d4ddc7f-sr876\" (UID: \"1e6180cf-888b-49fa-9c60-121d596a979e\") " pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:09.972534 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.972493    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e6180cf-888b-49fa-9c60-121d596a979e-trusted-ca-bundle\") pod \"console-7f9d4ddc7f-sr876\" (UID: \"1e6180cf-888b-49fa-9c60-121d596a979e\") " pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:09.973841 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.973816    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e6180cf-888b-49fa-9c60-121d596a979e-console-oauth-config\") pod \"console-7f9d4ddc7f-sr876\" (UID: \"1e6180cf-888b-49fa-9c60-121d596a979e\") " pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:09.973993 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.973974    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e6180cf-888b-49fa-9c60-121d596a979e-console-serving-cert\") pod \"console-7f9d4ddc7f-sr876\" (UID: \"1e6180cf-888b-49fa-9c60-121d596a979e\") " pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:09.982115 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:09.982060    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfgt7\" (UniqueName: \"kubernetes.io/projected/1e6180cf-888b-49fa-9c60-121d596a979e-kube-api-access-jfgt7\") pod \"console-7f9d4ddc7f-sr876\" (UID: \"1e6180cf-888b-49fa-9c60-121d596a979e\") " pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:10.041265 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:10.041228    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:10.336593 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:10.336508    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f9d4ddc7f-sr876"]
Sep 14 09:50:10.339575 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:50:10.339548    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e6180cf_888b_49fa_9c60_121d596a979e.slice/crio-95b026a6e77473f78f30781b154a45f262c21d70b062e636789b702b7032b324 WatchSource:0}: Error finding container 95b026a6e77473f78f30781b154a45f262c21d70b062e636789b702b7032b324: Status 404 returned error can't find the container with id 95b026a6e77473f78f30781b154a45f262c21d70b062e636789b702b7032b324
Sep 14 09:50:10.367648 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:10.367622    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9d4ddc7f-sr876" event={"ID":"1e6180cf-888b-49fa-9c60-121d596a979e","Type":"ContainerStarted","Data":"95b026a6e77473f78f30781b154a45f262c21d70b062e636789b702b7032b324"}
Sep 14 09:50:11.373575 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:11.373527    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9d4ddc7f-sr876" event={"ID":"1e6180cf-888b-49fa-9c60-121d596a979e","Type":"ContainerStarted","Data":"ce60f2f664a3012730eaabf4ebff20b90316950fd411a4b091100d7a7d749f8e"}
Sep 14 09:50:11.395955 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:11.395904    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f9d4ddc7f-sr876" podStartSLOduration=2.395889201 podStartE2EDuration="2.395889201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:50:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:50:11.39518669 +0000 UTC m=+427.253419047" watchObservedRunningTime="2026-09-14 09:50:11.395889201 +0000 UTC m=+427.254121627"
Sep 14 09:50:20.042202 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:20.042152    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:20.042688 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:20.042236    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:20.047140 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:20.047115    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:20.415336 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:20.415251    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f9d4ddc7f-sr876"
Sep 14 09:50:38.362215 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:38.362126    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tzmc6"
Sep 14 09:50:38.366188 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:50:38.366150    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-5dqmt"
Sep 14 09:51:18.021996 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:18.021951    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95"]
Sep 14 09:51:18.026376 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:18.026358    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95"
Sep 14 09:51:18.030274 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:18.030251    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 14 09:51:18.030387 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:18.030309    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 14 09:51:18.031666 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:18.031647    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-56q5q\""
Sep 14 09:51:18.046075 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:18.046051    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95"]
Sep 14 09:51:18.107701 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:18.107664    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhp6p\" (UniqueName: \"kubernetes.io/projected/4ae437d0-6855-4bc3-a4e0-545bbe2ae16d-kube-api-access-mhp6p\") pod \"limitador-operator-controller-manager-74495c69f8-ndh95\" (UID: \"4ae437d0-6855-4bc3-a4e0-545bbe2ae16d\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95"
Sep 14 09:51:18.209069 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:18.209028    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhp6p\" (UniqueName: \"kubernetes.io/projected/4ae437d0-6855-4bc3-a4e0-545bbe2ae16d-kube-api-access-mhp6p\") pod \"limitador-operator-controller-manager-74495c69f8-ndh95\" (UID: \"4ae437d0-6855-4bc3-a4e0-545bbe2ae16d\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95"
Sep 14 09:51:18.225094 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:18.225065    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhp6p\" (UniqueName: \"kubernetes.io/projected/4ae437d0-6855-4bc3-a4e0-545bbe2ae16d-kube-api-access-mhp6p\") pod \"limitador-operator-controller-manager-74495c69f8-ndh95\" (UID: \"4ae437d0-6855-4bc3-a4e0-545bbe2ae16d\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95"
Sep 14 09:51:18.336275 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:18.336181    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95"
Sep 14 09:51:18.615384 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:18.615306    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95"]
Sep 14 09:51:18.619022 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:51:18.618986    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ae437d0_6855_4bc3_a4e0_545bbe2ae16d.slice/crio-9476df06d43e7eb2aac16c70781da072e1ab4a2d19ff7aa25d8012ff531425d8 WatchSource:0}: Error finding container 9476df06d43e7eb2aac16c70781da072e1ab4a2d19ff7aa25d8012ff531425d8: Status 404 returned error can't find the container with id 9476df06d43e7eb2aac16c70781da072e1ab4a2d19ff7aa25d8012ff531425d8
Sep 14 09:51:18.654006 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:18.653977    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95" event={"ID":"4ae437d0-6855-4bc3-a4e0-545bbe2ae16d","Type":"ContainerStarted","Data":"9476df06d43e7eb2aac16c70781da072e1ab4a2d19ff7aa25d8012ff531425d8"}
Sep 14 09:51:21.667952 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:21.667919    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95" event={"ID":"4ae437d0-6855-4bc3-a4e0-545bbe2ae16d","Type":"ContainerStarted","Data":"9a8b782c49c4bce5a97636d1b807fb94e8339a0fc259cbb4799c16e7ba8d67f2"}
Sep 14 09:51:21.668356 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:21.667982    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95"
Sep 14 09:51:21.687909 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:21.687855    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95" podStartSLOduration=1.175071916 podStartE2EDuration="3.68783766s" totalImagesPullingTime="2.512765744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:51:21.685915775 +0000 UTC m=+497.544148140" watchObservedRunningTime="2026-09-14 09:51:21.68783766 +0000 UTC m=+497.546070015"
Sep 14 09:51:22.171386 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:22.171345    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"]
Sep 14 09:51:22.174565 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:22.174548    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"
Sep 14 09:51:22.182509 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:22.182489    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zdclx\""
Sep 14 09:51:22.205877 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:22.205845    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"]
Sep 14 09:51:22.345634 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:22.345590    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ab01653-7166-4727-878b-43fd1cee9355-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-pxst6\" (UID: \"8ab01653-7166-4727-878b-43fd1cee9355\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"
Sep 14 09:51:22.345634 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:22.345634    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc7wx\" (UniqueName: \"kubernetes.io/projected/8ab01653-7166-4727-878b-43fd1cee9355-kube-api-access-lc7wx\") pod \"kuadrant-operator-controller-manager-76f8f686bf-pxst6\" (UID: \"8ab01653-7166-4727-878b-43fd1cee9355\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"
Sep 14 09:51:22.447168 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:22.447133    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ab01653-7166-4727-878b-43fd1cee9355-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-pxst6\" (UID: \"8ab01653-7166-4727-878b-43fd1cee9355\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"
Sep 14 09:51:22.447354 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:22.447174    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc7wx\" (UniqueName: \"kubernetes.io/projected/8ab01653-7166-4727-878b-43fd1cee9355-kube-api-access-lc7wx\") pod \"kuadrant-operator-controller-manager-76f8f686bf-pxst6\" (UID: \"8ab01653-7166-4727-878b-43fd1cee9355\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"
Sep 14 09:51:22.447581 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:22.447558    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ab01653-7166-4727-878b-43fd1cee9355-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-pxst6\" (UID: \"8ab01653-7166-4727-878b-43fd1cee9355\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"
Sep 14 09:51:22.458920 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:22.458890    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc7wx\" (UniqueName: \"kubernetes.io/projected/8ab01653-7166-4727-878b-43fd1cee9355-kube-api-access-lc7wx\") pod \"kuadrant-operator-controller-manager-76f8f686bf-pxst6\" (UID: \"8ab01653-7166-4727-878b-43fd1cee9355\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"
Sep 14 09:51:22.483876 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:22.483839    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"
Sep 14 09:51:22.773442 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:22.773416    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"]
Sep 14 09:51:22.775624 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:51:22.775595    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ab01653_7166_4727_878b_43fd1cee9355.slice/crio-61b4b9d69c80196731162d467edaf734847ff6c57271be4b2da4fbbb3208d6df WatchSource:0}: Error finding container 61b4b9d69c80196731162d467edaf734847ff6c57271be4b2da4fbbb3208d6df: Status 404 returned error can't find the container with id 61b4b9d69c80196731162d467edaf734847ff6c57271be4b2da4fbbb3208d6df
Sep 14 09:51:23.679831 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:23.679788    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6" event={"ID":"8ab01653-7166-4727-878b-43fd1cee9355","Type":"ContainerStarted","Data":"61b4b9d69c80196731162d467edaf734847ff6c57271be4b2da4fbbb3208d6df"}
Sep 14 09:51:24.447295 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:24.447249    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j76h"]
Sep 14 09:51:24.450999 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:24.450971    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j76h"
Sep 14 09:51:24.453933 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:24.453890    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zbpn9\""
Sep 14 09:51:24.454561 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:24.454536    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 14 09:51:24.470944 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:24.470902    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j76h"]
Sep 14 09:51:24.568262 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:24.568225    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnnnx\" (UniqueName: \"kubernetes.io/projected/8a0e8f11-0743-4779-835b-86a6a40d1e09-kube-api-access-jnnnx\") pod \"dns-operator-controller-manager-7b84cd7c9c-4j76h\" (UID: \"8a0e8f11-0743-4779-835b-86a6a40d1e09\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j76h"
Sep 14 09:51:24.669391 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:24.669354    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnnnx\" (UniqueName: \"kubernetes.io/projected/8a0e8f11-0743-4779-835b-86a6a40d1e09-kube-api-access-jnnnx\") pod \"dns-operator-controller-manager-7b84cd7c9c-4j76h\" (UID: \"8a0e8f11-0743-4779-835b-86a6a40d1e09\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j76h"
Sep 14 09:51:24.681044 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:24.681006    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnnnx\" (UniqueName: \"kubernetes.io/projected/8a0e8f11-0743-4779-835b-86a6a40d1e09-kube-api-access-jnnnx\") pod \"dns-operator-controller-manager-7b84cd7c9c-4j76h\" (UID: \"8a0e8f11-0743-4779-835b-86a6a40d1e09\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j76h"
Sep 14 09:51:24.763976 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:24.763894    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j76h"
Sep 14 09:51:25.056554 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:25.056531    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j76h"]
Sep 14 09:51:25.059748 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:51:25.059688    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a0e8f11_0743_4779_835b_86a6a40d1e09.slice/crio-bc98e805928bc440d9615a211da299fdef4920f2c3aa9d6bca8b5d421c570b6b WatchSource:0}: Error finding container bc98e805928bc440d9615a211da299fdef4920f2c3aa9d6bca8b5d421c570b6b: Status 404 returned error can't find the container with id bc98e805928bc440d9615a211da299fdef4920f2c3aa9d6bca8b5d421c570b6b
Sep 14 09:51:25.691601 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:25.691568    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j76h" event={"ID":"8a0e8f11-0743-4779-835b-86a6a40d1e09","Type":"ContainerStarted","Data":"bc98e805928bc440d9615a211da299fdef4920f2c3aa9d6bca8b5d421c570b6b"}
Sep 14 09:51:26.699750 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:26.699671    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6" event={"ID":"8ab01653-7166-4727-878b-43fd1cee9355","Type":"ContainerStarted","Data":"a209527d98e758b953d8cd5014ece0921f1591a835ae66dafa0d27ca35329388"}
Sep 14 09:51:26.700264 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:26.699839    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"
Sep 14 09:51:26.732330 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:26.732270    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6" podStartSLOduration=0.927652397 podStartE2EDuration="4.732252492s" totalImagesPullingTime="3.804600095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:51:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:51:26.730103383 +0000 UTC m=+502.588335743" watchObservedRunningTime="2026-09-14 09:51:26.732252492 +0000 UTC m=+502.590484847"
Sep 14 09:51:27.260989 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:27.260950    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-pctnh"]
Sep 14 09:51:27.264964 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:27.264939    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-pctnh"
Sep 14 09:51:27.276322 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:27.276293    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-gjrvt\""
Sep 14 09:51:27.276817 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:27.276776    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-pctnh"]
Sep 14 09:51:27.394072 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:27.394029    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbjzv\" (UniqueName: \"kubernetes.io/projected/3c84466f-4ed3-4209-8999-4d0cd4f17b80-kube-api-access-bbjzv\") pod \"authorino-operator-76b478bd78-pctnh\" (UID: \"3c84466f-4ed3-4209-8999-4d0cd4f17b80\") " pod="kuadrant-system/authorino-operator-76b478bd78-pctnh"
Sep 14 09:51:27.494990 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:27.494895    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbjzv\" (UniqueName: \"kubernetes.io/projected/3c84466f-4ed3-4209-8999-4d0cd4f17b80-kube-api-access-bbjzv\") pod \"authorino-operator-76b478bd78-pctnh\" (UID: \"3c84466f-4ed3-4209-8999-4d0cd4f17b80\") " pod="kuadrant-system/authorino-operator-76b478bd78-pctnh"
Sep 14 09:51:27.530862 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:27.530842    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbjzv\" (UniqueName: \"kubernetes.io/projected/3c84466f-4ed3-4209-8999-4d0cd4f17b80-kube-api-access-bbjzv\") pod \"authorino-operator-76b478bd78-pctnh\" (UID: \"3c84466f-4ed3-4209-8999-4d0cd4f17b80\") " pod="kuadrant-system/authorino-operator-76b478bd78-pctnh"
Sep 14 09:51:27.576586 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:27.576558    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-pctnh"
Sep 14 09:51:27.706866 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:27.706827    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j76h" event={"ID":"8a0e8f11-0743-4779-835b-86a6a40d1e09","Type":"ContainerStarted","Data":"524f2173100265665fdd69778886fd42675dd7398fd188a6f0db45087ba00282"}
Sep 14 09:51:27.752778 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:27.752703    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j76h" podStartSLOduration=1.283766669 podStartE2EDuration="3.752685861s" totalImagesPullingTime="2.468919192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:51:27.750682741 +0000 UTC m=+503.608915122" watchObservedRunningTime="2026-09-14 09:51:27.752685861 +0000 UTC m=+503.610918216"
Sep 14 09:51:27.854898 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:27.854869    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-pctnh"]
Sep 14 09:51:27.857431 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:51:27.857404    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c84466f_4ed3_4209_8999_4d0cd4f17b80.slice/crio-f2a910aa86d38cbf69445cb5d8123a9650fe86213b7b6975e715bf3dc5f162be WatchSource:0}: Error finding container f2a910aa86d38cbf69445cb5d8123a9650fe86213b7b6975e715bf3dc5f162be: Status 404 returned error can't find the container with id f2a910aa86d38cbf69445cb5d8123a9650fe86213b7b6975e715bf3dc5f162be
Sep 14 09:51:28.713250 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:28.713199    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-pctnh" event={"ID":"3c84466f-4ed3-4209-8999-4d0cd4f17b80","Type":"ContainerStarted","Data":"f2a910aa86d38cbf69445cb5d8123a9650fe86213b7b6975e715bf3dc5f162be"}
Sep 14 09:51:28.713604 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:28.713356    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j76h"
Sep 14 09:51:29.680987 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:29.680961    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-7nl57"]
Sep 14 09:51:29.684191 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:29.684173    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7nl57"
Sep 14 09:51:29.687258 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:29.687234    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 14 09:51:29.687362 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:29.687235    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xslx2\""
Sep 14 09:51:29.687362 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:29.687333    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 14 09:51:29.692953 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:29.692922    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-7nl57"]
Sep 14 09:51:29.714620 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:29.714591    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3c98b92-1b4e-4656-a285-9ab2b65e5b17-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-7nl57\" (UID: \"e3c98b92-1b4e-4656-a285-9ab2b65e5b17\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7nl57"
Sep 14 09:51:29.715024 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:29.714633    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqskb\" (UniqueName: \"kubernetes.io/projected/e3c98b92-1b4e-4656-a285-9ab2b65e5b17-kube-api-access-nqskb\") pod \"kuadrant-console-plugin-fbdd4f445-7nl57\" (UID: \"e3c98b92-1b4e-4656-a285-9ab2b65e5b17\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7nl57"
Sep 14 09:51:29.715024 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:29.714701    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e3c98b92-1b4e-4656-a285-9ab2b65e5b17-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-7nl57\" (UID: \"e3c98b92-1b4e-4656-a285-9ab2b65e5b17\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7nl57"
Sep 14 09:51:29.719345 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:29.719318    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-pctnh" event={"ID":"3c84466f-4ed3-4209-8999-4d0cd4f17b80","Type":"ContainerStarted","Data":"906b6a2b0db9d7105c6c044a88f98e5b9982acdaace24d187921d94558a3c9cb"}
Sep 14 09:51:29.719472 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:29.719404    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-pctnh"
Sep 14 09:51:29.751186 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:29.751133    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-pctnh" podStartSLOduration=1.201782034 podStartE2EDuration="2.751117492s" totalImagesPullingTime="1.549335458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:51:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:51:29.749237999 +0000 UTC m=+505.607470356" watchObservedRunningTime="2026-09-14 09:51:29.751117492 +0000 UTC m=+505.609349911"
Sep 14 09:51:29.815404 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:29.815361    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqskb\" (UniqueName: \"kubernetes.io/projected/e3c98b92-1b4e-4656-a285-9ab2b65e5b17-kube-api-access-nqskb\") pod \"kuadrant-console-plugin-fbdd4f445-7nl57\" (UID: \"e3c98b92-1b4e-4656-a285-9ab2b65e5b17\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7nl57"
Sep 14 09:51:29.815592 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:29.815412    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e3c98b92-1b4e-4656-a285-9ab2b65e5b17-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-7nl57\" (UID: \"e3c98b92-1b4e-4656-a285-9ab2b65e5b17\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7nl57"
Sep 14 09:51:29.815592 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:29.815532    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3c98b92-1b4e-4656-a285-9ab2b65e5b17-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-7nl57\" (UID: \"e3c98b92-1b4e-4656-a285-9ab2b65e5b17\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7nl57"
Sep 14 09:51:29.815740 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:51:29.815688    2581 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 14 09:51:29.815813 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:51:29.815798    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3c98b92-1b4e-4656-a285-9ab2b65e5b17-plugin-serving-cert podName:e3c98b92-1b4e-4656-a285-9ab2b65e5b17 nodeName:}" failed. No retries permitted until 2026-09-14 09:51:30.315775231 +0000 UTC m=+506.174007584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/e3c98b92-1b4e-4656-a285-9ab2b65e5b17-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-7nl57" (UID: "e3c98b92-1b4e-4656-a285-9ab2b65e5b17") : secret "plugin-serving-cert" not found
Sep 14 09:51:29.816294 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:29.816276    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e3c98b92-1b4e-4656-a285-9ab2b65e5b17-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-7nl57\" (UID: \"e3c98b92-1b4e-4656-a285-9ab2b65e5b17\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7nl57"
Sep 14 09:51:29.827216 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:29.827192    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqskb\" (UniqueName: \"kubernetes.io/projected/e3c98b92-1b4e-4656-a285-9ab2b65e5b17-kube-api-access-nqskb\") pod \"kuadrant-console-plugin-fbdd4f445-7nl57\" (UID: \"e3c98b92-1b4e-4656-a285-9ab2b65e5b17\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7nl57"
Sep 14 09:51:30.318038 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:30.317999    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3c98b92-1b4e-4656-a285-9ab2b65e5b17-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-7nl57\" (UID: \"e3c98b92-1b4e-4656-a285-9ab2b65e5b17\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7nl57"
Sep 14 09:51:30.320476 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:30.320451    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3c98b92-1b4e-4656-a285-9ab2b65e5b17-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-7nl57\" (UID: \"e3c98b92-1b4e-4656-a285-9ab2b65e5b17\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7nl57"
Sep 14 09:51:30.593486 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:30.593397    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7nl57"
Sep 14 09:51:30.864687 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:30.864613    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-7nl57"]
Sep 14 09:51:30.867699 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:51:30.867671    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3c98b92_1b4e_4656_a285_9ab2b65e5b17.slice/crio-250c1ecc28cdf4a6294245b90501ca02bb21e068d7e8a719b095be867d24d549 WatchSource:0}: Error finding container 250c1ecc28cdf4a6294245b90501ca02bb21e068d7e8a719b095be867d24d549: Status 404 returned error can't find the container with id 250c1ecc28cdf4a6294245b90501ca02bb21e068d7e8a719b095be867d24d549
Sep 14 09:51:31.733107 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:31.733070    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7nl57" event={"ID":"e3c98b92-1b4e-4656-a285-9ab2b65e5b17","Type":"ContainerStarted","Data":"250c1ecc28cdf4a6294245b90501ca02bb21e068d7e8a719b095be867d24d549"}
Sep 14 09:51:32.675242 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:32.675208    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95"
Sep 14 09:51:35.753559 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:35.753519    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7nl57" event={"ID":"e3c98b92-1b4e-4656-a285-9ab2b65e5b17","Type":"ContainerStarted","Data":"089ffadab28457b34400963d2f9d8957afcefa12f35c218447866a0f541d51a8"}
Sep 14 09:51:35.775634 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:35.775581    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-7nl57" podStartSLOduration=2.344241856 podStartE2EDuration="6.775563514s" totalImagesPullingTime="4.431321658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:51:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:51:35.773959152 +0000 UTC m=+511.632191508" watchObservedRunningTime="2026-09-14 09:51:35.775563514 +0000 UTC m=+511.633795870"
Sep 14 09:51:37.709481 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:37.709447    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"
Sep 14 09:51:39.721344 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:39.721307    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j76h"
Sep 14 09:51:39.985776 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:39.985684    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"]
Sep 14 09:51:39.985971 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:39.985932    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6" podUID="8ab01653-7166-4727-878b-43fd1cee9355" containerName="manager" containerID="cri-o://a209527d98e758b953d8cd5014ece0921f1591a835ae66dafa0d27ca35329388" gracePeriod=2
Sep 14 09:51:40.020358 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.020321    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"]
Sep 14 09:51:40.033062 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:51:40.033015    2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8ab01653-7166-4727-878b-43fd1cee9355\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-pxst6\": pods \"kuadrant-operator-controller-manager-76f8f686bf-pxst6\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"
Sep 14 09:51:40.041734 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.041688    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95"]
Sep 14 09:51:40.042171 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.042136    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95" podUID="4ae437d0-6855-4bc3-a4e0-545bbe2ae16d" containerName="manager" containerID="cri-o://9a8b782c49c4bce5a97636d1b807fb94e8339a0fc259cbb4799c16e7ba8d67f2" gracePeriod=2
Sep 14 09:51:40.046612 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.046585    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79"]
Sep 14 09:51:40.047134 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.047092    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ab01653-7166-4727-878b-43fd1cee9355" containerName="manager"
Sep 14 09:51:40.047134 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.047111    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ab01653-7166-4727-878b-43fd1cee9355" containerName="manager"
Sep 14 09:51:40.047341 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.047195    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ab01653-7166-4727-878b-43fd1cee9355" containerName="manager"
Sep 14 09:51:40.051164 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.051144    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79"
Sep 14 09:51:40.051803 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:51:40.051773    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-pxst6\" is forbidden: User \"system:node:ip-10-0-132-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-247.ec2.internal' and this object" podUID="8ab01653-7166-4727-878b-43fd1cee9355" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"
Sep 14 09:51:40.052169 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.051883    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95"]
Sep 14 09:51:40.078024 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.077992    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79"]
Sep 14 09:51:40.090192 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.090163    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-d8w4t"]
Sep 14 09:51:40.090859 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.090824    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae437d0-6855-4bc3-a4e0-545bbe2ae16d" containerName="manager"
Sep 14 09:51:40.090859 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.090848    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae437d0-6855-4bc3-a4e0-545bbe2ae16d" containerName="manager"
Sep 14 09:51:40.091035 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.090931    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ae437d0-6855-4bc3-a4e0-545bbe2ae16d" containerName="manager"
Sep 14 09:51:40.093918 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.093895    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-d8w4t"
Sep 14 09:51:40.100187 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.100162    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3cf661b-5a90-40a6-89ad-fd9730c75fd8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2gz79\" (UID: \"e3cf661b-5a90-40a6-89ad-fd9730c75fd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79"
Sep 14 09:51:40.100285 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.100237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckhmj\" (UniqueName: \"kubernetes.io/projected/e3cf661b-5a90-40a6-89ad-fd9730c75fd8-kube-api-access-ckhmj\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2gz79\" (UID: \"e3cf661b-5a90-40a6-89ad-fd9730c75fd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79"
Sep 14 09:51:40.116474 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.116444    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-d8w4t"]
Sep 14 09:51:40.118156 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:51:40.118121    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-pxst6\" is forbidden: User \"system:node:ip-10-0-132-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-247.ec2.internal' and this object" podUID="8ab01653-7166-4727-878b-43fd1cee9355" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"
Sep 14 09:51:40.121159 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:51:40.121123    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ndh95\" is forbidden: User \"system:node:ip-10-0-132-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-247.ec2.internal' and this object" podUID="4ae437d0-6855-4bc3-a4e0-545bbe2ae16d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95"
Sep 14 09:51:40.123753 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:51:40.123697    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ndh95\" is forbidden: User \"system:node:ip-10-0-132-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-247.ec2.internal' and this object" podUID="4ae437d0-6855-4bc3-a4e0-545bbe2ae16d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95"
Sep 14 09:51:40.148531 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:51:40.148486    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-pxst6\" is forbidden: User \"system:node:ip-10-0-132-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-247.ec2.internal' and this object" podUID="8ab01653-7166-4727-878b-43fd1cee9355" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"
Sep 14 09:51:40.201033 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.200995    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbvrg\" (UniqueName: \"kubernetes.io/projected/b753abb4-856b-4525-9ae4-a061611f90d2-kube-api-access-lbvrg\") pod \"limitador-operator-controller-manager-74495c69f8-d8w4t\" (UID: \"b753abb4-856b-4525-9ae4-a061611f90d2\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-d8w4t"
Sep 14 09:51:40.201183 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.201111    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckhmj\" (UniqueName: \"kubernetes.io/projected/e3cf661b-5a90-40a6-89ad-fd9730c75fd8-kube-api-access-ckhmj\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2gz79\" (UID: \"e3cf661b-5a90-40a6-89ad-fd9730c75fd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79"
Sep 14 09:51:40.201183 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.201173    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3cf661b-5a90-40a6-89ad-fd9730c75fd8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2gz79\" (UID: \"e3cf661b-5a90-40a6-89ad-fd9730c75fd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79"
Sep 14 09:51:40.201781 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.201526    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3cf661b-5a90-40a6-89ad-fd9730c75fd8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2gz79\" (UID: \"e3cf661b-5a90-40a6-89ad-fd9730c75fd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79"
Sep 14 09:51:40.213776 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.213448    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckhmj\" (UniqueName: \"kubernetes.io/projected/e3cf661b-5a90-40a6-89ad-fd9730c75fd8-kube-api-access-ckhmj\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2gz79\" (UID: \"e3cf661b-5a90-40a6-89ad-fd9730c75fd8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79"
Sep 14 09:51:40.290823 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.290796    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"
Sep 14 09:51:40.293774 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.293753    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95"
Sep 14 09:51:40.294767 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:51:40.294743    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ndh95\" is forbidden: User \"system:node:ip-10-0-132-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-247.ec2.internal' and this object" podUID="4ae437d0-6855-4bc3-a4e0-545bbe2ae16d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95"
Sep 14 09:51:40.299385 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:51:40.299362    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-pxst6\" is forbidden: User \"system:node:ip-10-0-132-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-247.ec2.internal' and this object" podUID="8ab01653-7166-4727-878b-43fd1cee9355" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"
Sep 14 09:51:40.301816 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.301794    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbvrg\" (UniqueName: \"kubernetes.io/projected/b753abb4-856b-4525-9ae4-a061611f90d2-kube-api-access-lbvrg\") pod \"limitador-operator-controller-manager-74495c69f8-d8w4t\" (UID: \"b753abb4-856b-4525-9ae4-a061611f90d2\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-d8w4t"
Sep 14 09:51:40.305860 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:51:40.305837    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ndh95\" is forbidden: User \"system:node:ip-10-0-132-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-247.ec2.internal' and this object" podUID="4ae437d0-6855-4bc3-a4e0-545bbe2ae16d" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95"
Sep 14 09:51:40.313805 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:51:40.313775    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-pxst6\" is forbidden: User \"system:node:ip-10-0-132-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-247.ec2.internal' and this object" podUID="8ab01653-7166-4727-878b-43fd1cee9355" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"
Sep 14 09:51:40.328629 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.328608    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbvrg\" (UniqueName: \"kubernetes.io/projected/b753abb4-856b-4525-9ae4-a061611f90d2-kube-api-access-lbvrg\") pod \"limitador-operator-controller-manager-74495c69f8-d8w4t\" (UID: \"b753abb4-856b-4525-9ae4-a061611f90d2\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-d8w4t"
Sep 14 09:51:40.402695 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.402655    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lc7wx\" (UniqueName: \"kubernetes.io/projected/8ab01653-7166-4727-878b-43fd1cee9355-kube-api-access-lc7wx\") pod \"8ab01653-7166-4727-878b-43fd1cee9355\" (UID: \"8ab01653-7166-4727-878b-43fd1cee9355\") "
Sep 14 09:51:40.402840 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.402757    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhp6p\" (UniqueName: \"kubernetes.io/projected/4ae437d0-6855-4bc3-a4e0-545bbe2ae16d-kube-api-access-mhp6p\") pod \"4ae437d0-6855-4bc3-a4e0-545bbe2ae16d\" (UID: \"4ae437d0-6855-4bc3-a4e0-545bbe2ae16d\") "
Sep 14 09:51:40.402840 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.402811    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ab01653-7166-4727-878b-43fd1cee9355-extensions-socket-volume\") pod \"8ab01653-7166-4727-878b-43fd1cee9355\" (UID: \"8ab01653-7166-4727-878b-43fd1cee9355\") "
Sep 14 09:51:40.403314 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.403285    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ab01653-7166-4727-878b-43fd1cee9355-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8ab01653-7166-4727-878b-43fd1cee9355" (UID: "8ab01653-7166-4727-878b-43fd1cee9355"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 09:51:40.404920 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.404900    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ab01653-7166-4727-878b-43fd1cee9355-kube-api-access-lc7wx" (OuterVolumeSpecName: "kube-api-access-lc7wx") pod "8ab01653-7166-4727-878b-43fd1cee9355" (UID: "8ab01653-7166-4727-878b-43fd1cee9355"). InnerVolumeSpecName "kube-api-access-lc7wx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 09:51:40.404990 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.404930    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ae437d0-6855-4bc3-a4e0-545bbe2ae16d-kube-api-access-mhp6p" (OuterVolumeSpecName: "kube-api-access-mhp6p") pod "4ae437d0-6855-4bc3-a4e0-545bbe2ae16d" (UID: "4ae437d0-6855-4bc3-a4e0-545bbe2ae16d"). InnerVolumeSpecName "kube-api-access-mhp6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 09:51:40.423683 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.423652    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79"
Sep 14 09:51:40.429810 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.429786    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-d8w4t"
Sep 14 09:51:40.504402 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.504323    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ab01653-7166-4727-878b-43fd1cee9355-extensions-socket-volume\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:51:40.504402 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.504346    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lc7wx\" (UniqueName: \"kubernetes.io/projected/8ab01653-7166-4727-878b-43fd1cee9355-kube-api-access-lc7wx\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:51:40.504402 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.504356    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhp6p\" (UniqueName: \"kubernetes.io/projected/4ae437d0-6855-4bc3-a4e0-545bbe2ae16d-kube-api-access-mhp6p\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:51:40.655313 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.655233    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ae437d0-6855-4bc3-a4e0-545bbe2ae16d" path="/var/lib/kubelet/pods/4ae437d0-6855-4bc3-a4e0-545bbe2ae16d/volumes"
Sep 14 09:51:40.655593 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.655581    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ab01653-7166-4727-878b-43fd1cee9355" path="/var/lib/kubelet/pods/8ab01653-7166-4727-878b-43fd1cee9355/volumes"
Sep 14 09:51:40.726296 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.726265    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-pctnh"
Sep 14 09:51:40.727424 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.727404    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-d8w4t"]
Sep 14 09:51:40.729626 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:51:40.729603    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb753abb4_856b_4525_9ae4_a061611f90d2.slice/crio-6d2374ebe2c3336a603020f92554ea46b3172334a0a2416b5e5715fb8b55fc1b WatchSource:0}: Error finding container 6d2374ebe2c3336a603020f92554ea46b3172334a0a2416b5e5715fb8b55fc1b: Status 404 returned error can't find the container with id 6d2374ebe2c3336a603020f92554ea46b3172334a0a2416b5e5715fb8b55fc1b
Sep 14 09:51:40.758255 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.758228    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79"]
Sep 14 09:51:40.762861 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:51:40.762838    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3cf661b_5a90_40a6_89ad_fd9730c75fd8.slice/crio-68acfbae095bd9a0a208c38750cdb8c8cc2f0d47540f74bfc970bb4afcfc018c WatchSource:0}: Error finding container 68acfbae095bd9a0a208c38750cdb8c8cc2f0d47540f74bfc970bb4afcfc018c: Status 404 returned error can't find the container with id 68acfbae095bd9a0a208c38750cdb8c8cc2f0d47540f74bfc970bb4afcfc018c
Sep 14 09:51:40.783443 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.783410    2581 generic.go:356] "Generic (PLEG): container finished" podID="8ab01653-7166-4727-878b-43fd1cee9355" containerID="a209527d98e758b953d8cd5014ece0921f1591a835ae66dafa0d27ca35329388" exitCode=0
Sep 14 09:51:40.783555 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.783464    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-pxst6"
Sep 14 09:51:40.783615 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.783601    2581 scope.go:117] "RemoveContainer" containerID="a209527d98e758b953d8cd5014ece0921f1591a835ae66dafa0d27ca35329388"
Sep 14 09:51:40.786279 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.786248    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-d8w4t" event={"ID":"b753abb4-856b-4525-9ae4-a061611f90d2","Type":"ContainerStarted","Data":"6d2374ebe2c3336a603020f92554ea46b3172334a0a2416b5e5715fb8b55fc1b"}
Sep 14 09:51:40.788272 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.788247    2581 generic.go:356] "Generic (PLEG): container finished" podID="4ae437d0-6855-4bc3-a4e0-545bbe2ae16d" containerID="9a8b782c49c4bce5a97636d1b807fb94e8339a0fc259cbb4799c16e7ba8d67f2" exitCode=0
Sep 14 09:51:40.788362 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.788327    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndh95"
Sep 14 09:51:40.790434 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.790379    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79" event={"ID":"e3cf661b-5a90-40a6-89ad-fd9730c75fd8","Type":"ContainerStarted","Data":"68acfbae095bd9a0a208c38750cdb8c8cc2f0d47540f74bfc970bb4afcfc018c"}
Sep 14 09:51:40.797128 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.797101    2581 scope.go:117] "RemoveContainer" containerID="a209527d98e758b953d8cd5014ece0921f1591a835ae66dafa0d27ca35329388"
Sep 14 09:51:40.797468 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:51:40.797440    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a209527d98e758b953d8cd5014ece0921f1591a835ae66dafa0d27ca35329388\": container with ID starting with a209527d98e758b953d8cd5014ece0921f1591a835ae66dafa0d27ca35329388 not found: ID does not exist" containerID="a209527d98e758b953d8cd5014ece0921f1591a835ae66dafa0d27ca35329388"
Sep 14 09:51:40.797550 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.797480    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a209527d98e758b953d8cd5014ece0921f1591a835ae66dafa0d27ca35329388"} err="failed to get container status \"a209527d98e758b953d8cd5014ece0921f1591a835ae66dafa0d27ca35329388\": rpc error: code = NotFound desc = could not find container \"a209527d98e758b953d8cd5014ece0921f1591a835ae66dafa0d27ca35329388\": container with ID starting with a209527d98e758b953d8cd5014ece0921f1591a835ae66dafa0d27ca35329388 not found: ID does not exist"
Sep 14 09:51:40.797550 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.797504    2581 scope.go:117] "RemoveContainer" containerID="9a8b782c49c4bce5a97636d1b807fb94e8339a0fc259cbb4799c16e7ba8d67f2"
Sep 14 09:51:40.812953 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.812917    2581 scope.go:117] "RemoveContainer" containerID="9a8b782c49c4bce5a97636d1b807fb94e8339a0fc259cbb4799c16e7ba8d67f2"
Sep 14 09:51:40.813328 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:51:40.813308    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a8b782c49c4bce5a97636d1b807fb94e8339a0fc259cbb4799c16e7ba8d67f2\": container with ID starting with 9a8b782c49c4bce5a97636d1b807fb94e8339a0fc259cbb4799c16e7ba8d67f2 not found: ID does not exist" containerID="9a8b782c49c4bce5a97636d1b807fb94e8339a0fc259cbb4799c16e7ba8d67f2"
Sep 14 09:51:40.813395 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:40.813340    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a8b782c49c4bce5a97636d1b807fb94e8339a0fc259cbb4799c16e7ba8d67f2"} err="failed to get container status \"9a8b782c49c4bce5a97636d1b807fb94e8339a0fc259cbb4799c16e7ba8d67f2\": rpc error: code = NotFound desc = could not find container \"9a8b782c49c4bce5a97636d1b807fb94e8339a0fc259cbb4799c16e7ba8d67f2\": container with ID starting with 9a8b782c49c4bce5a97636d1b807fb94e8339a0fc259cbb4799c16e7ba8d67f2 not found: ID does not exist"
Sep 14 09:51:41.797395 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:41.797357    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-d8w4t" event={"ID":"b753abb4-856b-4525-9ae4-a061611f90d2","Type":"ContainerStarted","Data":"3809d8a3757703eed1515e0c4a8d21d384a9e22e4930b5a45f577c6f73b4f925"}
Sep 14 09:51:41.797875 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:41.797468    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-d8w4t"
Sep 14 09:51:41.800297 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:41.800272    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79" event={"ID":"e3cf661b-5a90-40a6-89ad-fd9730c75fd8","Type":"ContainerStarted","Data":"893b1901a9cd5d447e721aed43c7155ce4efa007328db6b4c4508c173f7b9446"}
Sep 14 09:51:41.800419 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:41.800335    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79"
Sep 14 09:51:41.833409 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:41.833355    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-d8w4t" podStartSLOduration=1.833340537 podStartE2EDuration="1.833340537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:51:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:51:41.827046253 +0000 UTC m=+517.685278610" watchObservedRunningTime="2026-09-14 09:51:41.833340537 +0000 UTC m=+517.691572893"
Sep 14 09:51:41.863643 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:41.863594    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79" podStartSLOduration=1.86357805 podStartE2EDuration="1.86357805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:51:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:51:41.861594918 +0000 UTC m=+517.719827274" watchObservedRunningTime="2026-09-14 09:51:41.86357805 +0000 UTC m=+517.721810406"
Sep 14 09:51:52.808384 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:52.808351    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79"
Sep 14 09:51:52.808875 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:52.808421    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-d8w4t"
Sep 14 09:51:56.178436 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:56.178398    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79"]
Sep 14 09:51:56.178916 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:56.178645    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79" podUID="e3cf661b-5a90-40a6-89ad-fd9730c75fd8" containerName="manager" containerID="cri-o://893b1901a9cd5d447e721aed43c7155ce4efa007328db6b4c4508c173f7b9446" gracePeriod=10
Sep 14 09:51:56.438382 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:56.438358    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79"
Sep 14 09:51:56.542268 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:56.542236    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckhmj\" (UniqueName: \"kubernetes.io/projected/e3cf661b-5a90-40a6-89ad-fd9730c75fd8-kube-api-access-ckhmj\") pod \"e3cf661b-5a90-40a6-89ad-fd9730c75fd8\" (UID: \"e3cf661b-5a90-40a6-89ad-fd9730c75fd8\") "
Sep 14 09:51:56.542426 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:56.542303    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3cf661b-5a90-40a6-89ad-fd9730c75fd8-extensions-socket-volume\") pod \"e3cf661b-5a90-40a6-89ad-fd9730c75fd8\" (UID: \"e3cf661b-5a90-40a6-89ad-fd9730c75fd8\") "
Sep 14 09:51:56.542632 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:56.542606    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3cf661b-5a90-40a6-89ad-fd9730c75fd8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e3cf661b-5a90-40a6-89ad-fd9730c75fd8" (UID: "e3cf661b-5a90-40a6-89ad-fd9730c75fd8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 09:51:56.544268 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:56.544246    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3cf661b-5a90-40a6-89ad-fd9730c75fd8-kube-api-access-ckhmj" (OuterVolumeSpecName: "kube-api-access-ckhmj") pod "e3cf661b-5a90-40a6-89ad-fd9730c75fd8" (UID: "e3cf661b-5a90-40a6-89ad-fd9730c75fd8"). InnerVolumeSpecName "kube-api-access-ckhmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 09:51:56.643499 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:56.643462    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3cf661b-5a90-40a6-89ad-fd9730c75fd8-extensions-socket-volume\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:51:56.643499 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:56.643490    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckhmj\" (UniqueName: \"kubernetes.io/projected/e3cf661b-5a90-40a6-89ad-fd9730c75fd8-kube-api-access-ckhmj\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:51:56.867640 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:56.867533    2581 generic.go:356] "Generic (PLEG): container finished" podID="e3cf661b-5a90-40a6-89ad-fd9730c75fd8" containerID="893b1901a9cd5d447e721aed43c7155ce4efa007328db6b4c4508c173f7b9446" exitCode=0
Sep 14 09:51:56.867640 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:56.867579    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79"
Sep 14 09:51:56.867640 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:56.867622    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79" event={"ID":"e3cf661b-5a90-40a6-89ad-fd9730c75fd8","Type":"ContainerDied","Data":"893b1901a9cd5d447e721aed43c7155ce4efa007328db6b4c4508c173f7b9446"}
Sep 14 09:51:56.867899 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:56.867672    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79" event={"ID":"e3cf661b-5a90-40a6-89ad-fd9730c75fd8","Type":"ContainerDied","Data":"68acfbae095bd9a0a208c38750cdb8c8cc2f0d47540f74bfc970bb4afcfc018c"}
Sep 14 09:51:56.867899 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:56.867730    2581 scope.go:117] "RemoveContainer" containerID="893b1901a9cd5d447e721aed43c7155ce4efa007328db6b4c4508c173f7b9446"
Sep 14 09:51:56.875866 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:56.875849    2581 scope.go:117] "RemoveContainer" containerID="893b1901a9cd5d447e721aed43c7155ce4efa007328db6b4c4508c173f7b9446"
Sep 14 09:51:56.876165 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:51:56.876141    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"893b1901a9cd5d447e721aed43c7155ce4efa007328db6b4c4508c173f7b9446\": container with ID starting with 893b1901a9cd5d447e721aed43c7155ce4efa007328db6b4c4508c173f7b9446 not found: ID does not exist" containerID="893b1901a9cd5d447e721aed43c7155ce4efa007328db6b4c4508c173f7b9446"
Sep 14 09:51:56.876300 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:56.876174    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"893b1901a9cd5d447e721aed43c7155ce4efa007328db6b4c4508c173f7b9446"} err="failed to get container status \"893b1901a9cd5d447e721aed43c7155ce4efa007328db6b4c4508c173f7b9446\": rpc error: code = NotFound desc = could not find container \"893b1901a9cd5d447e721aed43c7155ce4efa007328db6b4c4508c173f7b9446\": container with ID starting with 893b1901a9cd5d447e721aed43c7155ce4efa007328db6b4c4508c173f7b9446 not found: ID does not exist"
Sep 14 09:51:56.889864 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:56.889842    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79"]
Sep 14 09:51:56.900454 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:56.900423    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2gz79"]
Sep 14 09:51:58.655391 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:51:58.655347    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3cf661b-5a90-40a6-89ad-fd9730c75fd8" path="/var/lib/kubelet/pods/e3cf661b-5a90-40a6-89ad-fd9730c75fd8/volumes"
Sep 14 09:52:12.555920 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.555886    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"]
Sep 14 09:52:12.556303 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.556206    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3cf661b-5a90-40a6-89ad-fd9730c75fd8" containerName="manager"
Sep 14 09:52:12.556303 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.556217    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3cf661b-5a90-40a6-89ad-fd9730c75fd8" containerName="manager"
Sep 14 09:52:12.556303 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.556280    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3cf661b-5a90-40a6-89ad-fd9730c75fd8" containerName="manager"
Sep 14 09:52:12.576062 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.576024    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"]
Sep 14 09:52:12.576233 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.576138    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.578863 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.578844    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 14 09:52:12.579325 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.579305    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-b2pms\""
Sep 14 09:52:12.686067 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.686028    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.686264 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.686086    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.686264 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.686117    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.686264 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.686140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.686264 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.686169    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.686264 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.686217    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.686264 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.686241    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.686502 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.686309    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnsfw\" (UniqueName: \"kubernetes.io/projected/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-kube-api-access-qnsfw\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.686502 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.686368    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.787667 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.787631    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.787667 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.787672    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.787938 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.787742    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.787938 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.787771    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.787938 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.787794    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.787938 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.787843    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.787938 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.787870    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.788197 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.788137    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.788247 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.788208    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.788310 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.788251    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.788366 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.788308    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnsfw\" (UniqueName: \"kubernetes.io/projected/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-kube-api-access-qnsfw\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.788452 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.788430    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.788514 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.788485    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.788566 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.788518    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.790252 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.790230    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.790405 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.790386    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.798558 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.798529    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.798643 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.798599    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnsfw\" (UniqueName: \"kubernetes.io/projected/58f012c5-1b30-4c57-91dc-8d94ff3f7ee8-kube-api-access-qnsfw\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w9vt5\" (UID: \"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:12.886231 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:12.886135    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:13.164002 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:13.163973    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"]
Sep 14 09:52:13.166724 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:52:13.166685    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f012c5_1b30_4c57_91dc_8d94ff3f7ee8.slice/crio-68b454026340b70f1da34bf663c1f952a12f16b64c66ee12634948c5394e7c0c WatchSource:0}: Error finding container 68b454026340b70f1da34bf663c1f952a12f16b64c66ee12634948c5394e7c0c: Status 404 returned error can't find the container with id 68b454026340b70f1da34bf663c1f952a12f16b64c66ee12634948c5394e7c0c
Sep 14 09:52:13.947995 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:13.947962    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5" event={"ID":"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8","Type":"ContainerStarted","Data":"68b454026340b70f1da34bf663c1f952a12f16b64c66ee12634948c5394e7c0c"}
Sep 14 09:52:16.049651 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:16.049612    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 09:52:16.050012 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:16.049746    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 09:52:16.050012 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:16.049796    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 09:52:16.970372 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:16.970331    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5" event={"ID":"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8","Type":"ContainerStarted","Data":"09c6e5aa7d6f1942137271bd3978ba26491c761b62346374456ff5cdff565f28"}
Sep 14 09:52:16.995318 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:16.995262    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5" podStartSLOduration=2.114713481 podStartE2EDuration="4.995244689s" totalImagesPullingTime="2.880531208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:52:16.993649834 +0000 UTC m=+552.851882190" watchObservedRunningTime="2026-09-14 09:52:16.995244689 +0000 UTC m=+552.853477045"
Sep 14 09:52:17.886758 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:17.886687    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:17.891469 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:17.891443    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:17.975088 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:17.975053    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:17.976111 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:17.976086    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:52:18.004300 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.004262    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5vdfs"]
Sep 14 09:52:18.007815 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.007796    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5vdfs"
Sep 14 09:52:18.010905 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.010878    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 14 09:52:18.015971 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.015940    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5vdfs"]
Sep 14 09:52:18.098762 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.098729    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5vdfs"]
Sep 14 09:52:18.135237 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.135206    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/252456d2-abbd-45f4-a505-bb28461845ff-config-file\") pod \"limitador-limitador-8588749977-5vdfs\" (UID: \"252456d2-abbd-45f4-a505-bb28461845ff\") " pod="kuadrant-system/limitador-limitador-8588749977-5vdfs"
Sep 14 09:52:18.135411 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.135343    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzm5f\" (UniqueName: \"kubernetes.io/projected/252456d2-abbd-45f4-a505-bb28461845ff-kube-api-access-zzm5f\") pod \"limitador-limitador-8588749977-5vdfs\" (UID: \"252456d2-abbd-45f4-a505-bb28461845ff\") " pod="kuadrant-system/limitador-limitador-8588749977-5vdfs"
Sep 14 09:52:18.236187 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.236145    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/252456d2-abbd-45f4-a505-bb28461845ff-config-file\") pod \"limitador-limitador-8588749977-5vdfs\" (UID: \"252456d2-abbd-45f4-a505-bb28461845ff\") " pod="kuadrant-system/limitador-limitador-8588749977-5vdfs"
Sep 14 09:52:18.236398 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.236211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzm5f\" (UniqueName: \"kubernetes.io/projected/252456d2-abbd-45f4-a505-bb28461845ff-kube-api-access-zzm5f\") pod \"limitador-limitador-8588749977-5vdfs\" (UID: \"252456d2-abbd-45f4-a505-bb28461845ff\") " pod="kuadrant-system/limitador-limitador-8588749977-5vdfs"
Sep 14 09:52:18.236912 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.236879    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/252456d2-abbd-45f4-a505-bb28461845ff-config-file\") pod \"limitador-limitador-8588749977-5vdfs\" (UID: \"252456d2-abbd-45f4-a505-bb28461845ff\") " pod="kuadrant-system/limitador-limitador-8588749977-5vdfs"
Sep 14 09:52:18.248430 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.248394    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzm5f\" (UniqueName: \"kubernetes.io/projected/252456d2-abbd-45f4-a505-bb28461845ff-kube-api-access-zzm5f\") pod \"limitador-limitador-8588749977-5vdfs\" (UID: \"252456d2-abbd-45f4-a505-bb28461845ff\") " pod="kuadrant-system/limitador-limitador-8588749977-5vdfs"
Sep 14 09:52:18.291611 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.291575    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 09:52:18.295277 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.295256    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"
Sep 14 09:52:18.313387 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.313350    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 09:52:18.321727 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.321688    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5vdfs"
Sep 14 09:52:18.328182 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.328153    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 09:52:18.437932 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.437893    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/886a10ce-b188-4cda-a0fc-e0195ef605db-config-file\") pod \"limitador-limitador-84994f7ffc-zzk2n\" (UID: \"886a10ce-b188-4cda-a0fc-e0195ef605db\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"
Sep 14 09:52:18.438120 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.437953    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxgrv\" (UniqueName: \"kubernetes.io/projected/886a10ce-b188-4cda-a0fc-e0195ef605db-kube-api-access-zxgrv\") pod \"limitador-limitador-84994f7ffc-zzk2n\" (UID: \"886a10ce-b188-4cda-a0fc-e0195ef605db\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"
Sep 14 09:52:18.539209 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.539098    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxgrv\" (UniqueName: \"kubernetes.io/projected/886a10ce-b188-4cda-a0fc-e0195ef605db-kube-api-access-zxgrv\") pod \"limitador-limitador-84994f7ffc-zzk2n\" (UID: \"886a10ce-b188-4cda-a0fc-e0195ef605db\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"
Sep 14 09:52:18.539382 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.539217    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/886a10ce-b188-4cda-a0fc-e0195ef605db-config-file\") pod \"limitador-limitador-84994f7ffc-zzk2n\" (UID: \"886a10ce-b188-4cda-a0fc-e0195ef605db\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"
Sep 14 09:52:18.539924 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.539901    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/886a10ce-b188-4cda-a0fc-e0195ef605db-config-file\") pod \"limitador-limitador-84994f7ffc-zzk2n\" (UID: \"886a10ce-b188-4cda-a0fc-e0195ef605db\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"
Sep 14 09:52:18.550292 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.550269    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxgrv\" (UniqueName: \"kubernetes.io/projected/886a10ce-b188-4cda-a0fc-e0195ef605db-kube-api-access-zxgrv\") pod \"limitador-limitador-84994f7ffc-zzk2n\" (UID: \"886a10ce-b188-4cda-a0fc-e0195ef605db\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"
Sep 14 09:52:18.603221 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.603195    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5vdfs"]
Sep 14 09:52:18.604850 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:52:18.604822    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252456d2_abbd_45f4_a505_bb28461845ff.slice/crio-cda84e20431905de2fb0a805919b5c21fa405fcd7635889658b555aea7da9aa9 WatchSource:0}: Error finding container cda84e20431905de2fb0a805919b5c21fa405fcd7635889658b555aea7da9aa9: Status 404 returned error can't find the container with id cda84e20431905de2fb0a805919b5c21fa405fcd7635889658b555aea7da9aa9
Sep 14 09:52:18.605647 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.605618    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"
Sep 14 09:52:18.879625 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.879598    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 09:52:18.881879 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:52:18.881850    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod886a10ce_b188_4cda_a0fc_e0195ef605db.slice/crio-ef860cb47e2e39758367be32fc5eb4b7f4fdf4ea1cab8ae1f954acaf32642639 WatchSource:0}: Error finding container ef860cb47e2e39758367be32fc5eb4b7f4fdf4ea1cab8ae1f954acaf32642639: Status 404 returned error can't find the container with id ef860cb47e2e39758367be32fc5eb4b7f4fdf4ea1cab8ae1f954acaf32642639
Sep 14 09:52:18.981313 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.981276    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-zzk2n" event={"ID":"886a10ce-b188-4cda-a0fc-e0195ef605db","Type":"ContainerStarted","Data":"ef860cb47e2e39758367be32fc5eb4b7f4fdf4ea1cab8ae1f954acaf32642639"}
Sep 14 09:52:18.982525 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:18.982495    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5vdfs" event={"ID":"252456d2-abbd-45f4-a505-bb28461845ff","Type":"ContainerStarted","Data":"cda84e20431905de2fb0a805919b5c21fa405fcd7635889658b555aea7da9aa9"}
Sep 14 09:52:19.992164 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:19.992067    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5vdfs" event={"ID":"252456d2-abbd-45f4-a505-bb28461845ff","Type":"ContainerStarted","Data":"5efe0f8cb057c4295dcb440b3ec0e772db0ad2472d9bef7bd5258dcbd08d764a"}
Sep 14 09:52:19.992595 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:19.992179    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-5vdfs"
Sep 14 09:52:19.993745 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:19.993697    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-zzk2n" event={"ID":"886a10ce-b188-4cda-a0fc-e0195ef605db","Type":"ContainerStarted","Data":"51da2e82f8605706733cdf8e255322812c2c6d22b6e1bb79e1c1a4744574b47c"}
Sep 14 09:52:19.993916 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:19.993900    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"
Sep 14 09:52:20.016645 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:20.016597    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-5vdfs" podStartSLOduration=1.8825071370000002 podStartE2EDuration="3.016582169s" totalImagesPullingTime="1.134075032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:52:20.016365408 +0000 UTC m=+555.874597764" watchObservedRunningTime="2026-09-14 09:52:20.016582169 +0000 UTC m=+555.874814524"
Sep 14 09:52:20.038852 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:20.038798    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-zzk2n" podStartSLOduration=1.179757356 podStartE2EDuration="2.03878215s" totalImagesPullingTime="859.024794ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:52:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:52:20.037017275 +0000 UTC m=+555.895249631" watchObservedRunningTime="2026-09-14 09:52:20.03878215 +0000 UTC m=+555.897014503"
Sep 14 09:52:30.999750 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:30.999693    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-5vdfs"
Sep 14 09:52:31.000323 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:30.999796    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"
Sep 14 09:52:31.062898 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:31.062864    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5vdfs"]
Sep 14 09:52:31.063072 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:31.063047    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-5vdfs" podUID="252456d2-abbd-45f4-a505-bb28461845ff" containerName="limitador" containerID="cri-o://5efe0f8cb057c4295dcb440b3ec0e772db0ad2472d9bef7bd5258dcbd08d764a" gracePeriod=30
Sep 14 09:52:31.621012 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:31.620982    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5vdfs"
Sep 14 09:52:31.661855 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:31.653655    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/252456d2-abbd-45f4-a505-bb28461845ff-config-file\") pod \"252456d2-abbd-45f4-a505-bb28461845ff\" (UID: \"252456d2-abbd-45f4-a505-bb28461845ff\") "
Sep 14 09:52:31.661855 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:31.653765    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzm5f\" (UniqueName: \"kubernetes.io/projected/252456d2-abbd-45f4-a505-bb28461845ff-kube-api-access-zzm5f\") pod \"252456d2-abbd-45f4-a505-bb28461845ff\" (UID: \"252456d2-abbd-45f4-a505-bb28461845ff\") "
Sep 14 09:52:31.661855 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:31.654794    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/252456d2-abbd-45f4-a505-bb28461845ff-config-file" (OuterVolumeSpecName: "config-file") pod "252456d2-abbd-45f4-a505-bb28461845ff" (UID: "252456d2-abbd-45f4-a505-bb28461845ff"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 09:52:31.661855 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:31.659192    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/252456d2-abbd-45f4-a505-bb28461845ff-kube-api-access-zzm5f" (OuterVolumeSpecName: "kube-api-access-zzm5f") pod "252456d2-abbd-45f4-a505-bb28461845ff" (UID: "252456d2-abbd-45f4-a505-bb28461845ff"). InnerVolumeSpecName "kube-api-access-zzm5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 09:52:31.756128 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:31.756073    2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/252456d2-abbd-45f4-a505-bb28461845ff-config-file\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:52:31.756128 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:31.756114    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzm5f\" (UniqueName: \"kubernetes.io/projected/252456d2-abbd-45f4-a505-bb28461845ff-kube-api-access-zzm5f\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:52:32.047474 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:32.047437    2581 generic.go:356] "Generic (PLEG): container finished" podID="252456d2-abbd-45f4-a505-bb28461845ff" containerID="5efe0f8cb057c4295dcb440b3ec0e772db0ad2472d9bef7bd5258dcbd08d764a" exitCode=0
Sep 14 09:52:32.047474 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:32.047475    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-5vdfs"
Sep 14 09:52:32.047948 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:32.047490    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5vdfs" event={"ID":"252456d2-abbd-45f4-a505-bb28461845ff","Type":"ContainerDied","Data":"5efe0f8cb057c4295dcb440b3ec0e772db0ad2472d9bef7bd5258dcbd08d764a"}
Sep 14 09:52:32.047948 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:32.047532    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-5vdfs" event={"ID":"252456d2-abbd-45f4-a505-bb28461845ff","Type":"ContainerDied","Data":"cda84e20431905de2fb0a805919b5c21fa405fcd7635889658b555aea7da9aa9"}
Sep 14 09:52:32.047948 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:32.047552    2581 scope.go:117] "RemoveContainer" containerID="5efe0f8cb057c4295dcb440b3ec0e772db0ad2472d9bef7bd5258dcbd08d764a"
Sep 14 09:52:32.056472 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:32.056449    2581 scope.go:117] "RemoveContainer" containerID="5efe0f8cb057c4295dcb440b3ec0e772db0ad2472d9bef7bd5258dcbd08d764a"
Sep 14 09:52:32.056775 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:52:32.056750    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5efe0f8cb057c4295dcb440b3ec0e772db0ad2472d9bef7bd5258dcbd08d764a\": container with ID starting with 5efe0f8cb057c4295dcb440b3ec0e772db0ad2472d9bef7bd5258dcbd08d764a not found: ID does not exist" containerID="5efe0f8cb057c4295dcb440b3ec0e772db0ad2472d9bef7bd5258dcbd08d764a"
Sep 14 09:52:32.056873 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:32.056780    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5efe0f8cb057c4295dcb440b3ec0e772db0ad2472d9bef7bd5258dcbd08d764a"} err="failed to get container status \"5efe0f8cb057c4295dcb440b3ec0e772db0ad2472d9bef7bd5258dcbd08d764a\": rpc error: code = NotFound desc = could not find container \"5efe0f8cb057c4295dcb440b3ec0e772db0ad2472d9bef7bd5258dcbd08d764a\": container with ID starting with 5efe0f8cb057c4295dcb440b3ec0e772db0ad2472d9bef7bd5258dcbd08d764a not found: ID does not exist"
Sep 14 09:52:32.070370 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:32.070321    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5vdfs"]
Sep 14 09:52:32.075871 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:32.075840    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-5vdfs"]
Sep 14 09:52:32.655890 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:32.655860    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="252456d2-abbd-45f4-a505-bb28461845ff" path="/var/lib/kubelet/pods/252456d2-abbd-45f4-a505-bb28461845ff/volumes"
Sep 14 09:52:54.008294 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.008259    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b687449c8-5s978"]
Sep 14 09:52:54.009038 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.008593    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="252456d2-abbd-45f4-a505-bb28461845ff" containerName="limitador"
Sep 14 09:52:54.009038 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.008604    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="252456d2-abbd-45f4-a505-bb28461845ff" containerName="limitador"
Sep 14 09:52:54.009038 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.008657    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="252456d2-abbd-45f4-a505-bb28461845ff" containerName="limitador"
Sep 14 09:52:54.016724 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.016689    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b687449c8-5s978"
Sep 14 09:52:54.023489 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.023335    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 14 09:52:54.023489 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.023370    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 14 09:52:54.023641 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.023625    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 14 09:52:54.024508 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.024486    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-cghpj\""
Sep 14 09:52:54.026762 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.026737    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b687449c8-5s978"]
Sep 14 09:52:54.148613 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.148575    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a42757b5-9e6d-47f5-83f4-09662dbfd366-webhook-cert\") pod \"maas-controller-7b687449c8-5s978\" (UID: \"a42757b5-9e6d-47f5-83f4-09662dbfd366\") " pod="opendatahub/maas-controller-7b687449c8-5s978"
Sep 14 09:52:54.148824 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.148634    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a42757b5-9e6d-47f5-83f4-09662dbfd366-metrics-certs\") pod \"maas-controller-7b687449c8-5s978\" (UID: \"a42757b5-9e6d-47f5-83f4-09662dbfd366\") " pod="opendatahub/maas-controller-7b687449c8-5s978"
Sep 14 09:52:54.148824 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.148671    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dhqs\" (UniqueName: \"kubernetes.io/projected/a42757b5-9e6d-47f5-83f4-09662dbfd366-kube-api-access-4dhqs\") pod \"maas-controller-7b687449c8-5s978\" (UID: \"a42757b5-9e6d-47f5-83f4-09662dbfd366\") " pod="opendatahub/maas-controller-7b687449c8-5s978"
Sep 14 09:52:54.200282 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.200242    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6dfbdc546b-tzlgv"]
Sep 14 09:52:54.203805 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.203781    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dfbdc546b-tzlgv"
Sep 14 09:52:54.218779 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.218750    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dfbdc546b-tzlgv"]
Sep 14 09:52:54.249228 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.249184    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a42757b5-9e6d-47f5-83f4-09662dbfd366-webhook-cert\") pod \"maas-controller-7b687449c8-5s978\" (UID: \"a42757b5-9e6d-47f5-83f4-09662dbfd366\") " pod="opendatahub/maas-controller-7b687449c8-5s978"
Sep 14 09:52:54.249425 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.249253    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a42757b5-9e6d-47f5-83f4-09662dbfd366-metrics-certs\") pod \"maas-controller-7b687449c8-5s978\" (UID: \"a42757b5-9e6d-47f5-83f4-09662dbfd366\") " pod="opendatahub/maas-controller-7b687449c8-5s978"
Sep 14 09:52:54.249425 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.249283    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dhqs\" (UniqueName: \"kubernetes.io/projected/a42757b5-9e6d-47f5-83f4-09662dbfd366-kube-api-access-4dhqs\") pod \"maas-controller-7b687449c8-5s978\" (UID: \"a42757b5-9e6d-47f5-83f4-09662dbfd366\") " pod="opendatahub/maas-controller-7b687449c8-5s978"
Sep 14 09:52:54.249425 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:52:54.249345    2581 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 14 09:52:54.249586 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:52:54.249432    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a42757b5-9e6d-47f5-83f4-09662dbfd366-webhook-cert podName:a42757b5-9e6d-47f5-83f4-09662dbfd366 nodeName:}" failed. No retries permitted until 2026-09-14 09:52:54.749411393 +0000 UTC m=+590.607643745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/a42757b5-9e6d-47f5-83f4-09662dbfd366-webhook-cert") pod "maas-controller-7b687449c8-5s978" (UID: "a42757b5-9e6d-47f5-83f4-09662dbfd366") : secret "maas-controller-webhook-cert" not found
Sep 14 09:52:54.251723 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.251687    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a42757b5-9e6d-47f5-83f4-09662dbfd366-metrics-certs\") pod \"maas-controller-7b687449c8-5s978\" (UID: \"a42757b5-9e6d-47f5-83f4-09662dbfd366\") " pod="opendatahub/maas-controller-7b687449c8-5s978"
Sep 14 09:52:54.262415 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.262342    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dhqs\" (UniqueName: \"kubernetes.io/projected/a42757b5-9e6d-47f5-83f4-09662dbfd366-kube-api-access-4dhqs\") pod \"maas-controller-7b687449c8-5s978\" (UID: \"a42757b5-9e6d-47f5-83f4-09662dbfd366\") " pod="opendatahub/maas-controller-7b687449c8-5s978"
Sep 14 09:52:54.349982 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.349941    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfj6q\" (UniqueName: \"kubernetes.io/projected/7479590e-8806-4577-bf15-cfdc5cafd92a-kube-api-access-bfj6q\") pod \"maas-controller-6dfbdc546b-tzlgv\" (UID: \"7479590e-8806-4577-bf15-cfdc5cafd92a\") " pod="opendatahub/maas-controller-6dfbdc546b-tzlgv"
Sep 14 09:52:54.350182 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.350019    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7479590e-8806-4577-bf15-cfdc5cafd92a-webhook-cert\") pod \"maas-controller-6dfbdc546b-tzlgv\" (UID: \"7479590e-8806-4577-bf15-cfdc5cafd92a\") " pod="opendatahub/maas-controller-6dfbdc546b-tzlgv"
Sep 14 09:52:54.350182 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.350092    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7479590e-8806-4577-bf15-cfdc5cafd92a-metrics-certs\") pod \"maas-controller-6dfbdc546b-tzlgv\" (UID: \"7479590e-8806-4577-bf15-cfdc5cafd92a\") " pod="opendatahub/maas-controller-6dfbdc546b-tzlgv"
Sep 14 09:52:54.451135 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.451087    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfj6q\" (UniqueName: \"kubernetes.io/projected/7479590e-8806-4577-bf15-cfdc5cafd92a-kube-api-access-bfj6q\") pod \"maas-controller-6dfbdc546b-tzlgv\" (UID: \"7479590e-8806-4577-bf15-cfdc5cafd92a\") " pod="opendatahub/maas-controller-6dfbdc546b-tzlgv"
Sep 14 09:52:54.451345 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.451179    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7479590e-8806-4577-bf15-cfdc5cafd92a-webhook-cert\") pod \"maas-controller-6dfbdc546b-tzlgv\" (UID: \"7479590e-8806-4577-bf15-cfdc5cafd92a\") " pod="opendatahub/maas-controller-6dfbdc546b-tzlgv"
Sep 14 09:52:54.451345 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.451206    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7479590e-8806-4577-bf15-cfdc5cafd92a-metrics-certs\") pod \"maas-controller-6dfbdc546b-tzlgv\" (UID: \"7479590e-8806-4577-bf15-cfdc5cafd92a\") " pod="opendatahub/maas-controller-6dfbdc546b-tzlgv"
Sep 14 09:52:54.451345 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:52:54.451319    2581 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 14 09:52:54.451510 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:52:54.451406    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7479590e-8806-4577-bf15-cfdc5cafd92a-webhook-cert podName:7479590e-8806-4577-bf15-cfdc5cafd92a nodeName:}" failed. No retries permitted until 2026-09-14 09:52:54.951385065 +0000 UTC m=+590.809617434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/7479590e-8806-4577-bf15-cfdc5cafd92a-webhook-cert") pod "maas-controller-6dfbdc546b-tzlgv" (UID: "7479590e-8806-4577-bf15-cfdc5cafd92a") : secret "maas-controller-webhook-cert" not found
Sep 14 09:52:54.453822 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.453794    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7479590e-8806-4577-bf15-cfdc5cafd92a-metrics-certs\") pod \"maas-controller-6dfbdc546b-tzlgv\" (UID: \"7479590e-8806-4577-bf15-cfdc5cafd92a\") " pod="opendatahub/maas-controller-6dfbdc546b-tzlgv"
Sep 14 09:52:54.461689 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.461660    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfj6q\" (UniqueName: \"kubernetes.io/projected/7479590e-8806-4577-bf15-cfdc5cafd92a-kube-api-access-bfj6q\") pod \"maas-controller-6dfbdc546b-tzlgv\" (UID: \"7479590e-8806-4577-bf15-cfdc5cafd92a\") " pod="opendatahub/maas-controller-6dfbdc546b-tzlgv"
Sep 14 09:52:54.753581 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.753545    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a42757b5-9e6d-47f5-83f4-09662dbfd366-webhook-cert\") pod \"maas-controller-7b687449c8-5s978\" (UID: \"a42757b5-9e6d-47f5-83f4-09662dbfd366\") " pod="opendatahub/maas-controller-7b687449c8-5s978"
Sep 14 09:52:54.756245 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.756218    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a42757b5-9e6d-47f5-83f4-09662dbfd366-webhook-cert\") pod \"maas-controller-7b687449c8-5s978\" (UID: \"a42757b5-9e6d-47f5-83f4-09662dbfd366\") " pod="opendatahub/maas-controller-7b687449c8-5s978"
Sep 14 09:52:54.928401 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.928353    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b687449c8-5s978"
Sep 14 09:52:54.955178 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.955141    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7479590e-8806-4577-bf15-cfdc5cafd92a-webhook-cert\") pod \"maas-controller-6dfbdc546b-tzlgv\" (UID: \"7479590e-8806-4577-bf15-cfdc5cafd92a\") " pod="opendatahub/maas-controller-6dfbdc546b-tzlgv"
Sep 14 09:52:54.957522 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:54.957488    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7479590e-8806-4577-bf15-cfdc5cafd92a-webhook-cert\") pod \"maas-controller-6dfbdc546b-tzlgv\" (UID: \"7479590e-8806-4577-bf15-cfdc5cafd92a\") " pod="opendatahub/maas-controller-6dfbdc546b-tzlgv"
Sep 14 09:52:55.114162 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:55.114053    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dfbdc546b-tzlgv"
Sep 14 09:52:55.204612 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:55.204587    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b687449c8-5s978"]
Sep 14 09:52:55.206375 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:52:55.206347    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda42757b5_9e6d_47f5_83f4_09662dbfd366.slice/crio-43af2710d4796c3bf767f4f2f4088a2310f84a729a2698c480427c2b62c8dc9d WatchSource:0}: Error finding container 43af2710d4796c3bf767f4f2f4088a2310f84a729a2698c480427c2b62c8dc9d: Status 404 returned error can't find the container with id 43af2710d4796c3bf767f4f2f4088a2310f84a729a2698c480427c2b62c8dc9d
Sep 14 09:52:55.389792 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:55.389741    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dfbdc546b-tzlgv"]
Sep 14 09:52:55.392083 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:52:55.392045    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7479590e_8806_4577_bf15_cfdc5cafd92a.slice/crio-17b740157818540265daf713b36eeb91c00676ba36aa09aaeb553f51ec186238 WatchSource:0}: Error finding container 17b740157818540265daf713b36eeb91c00676ba36aa09aaeb553f51ec186238: Status 404 returned error can't find the container with id 17b740157818540265daf713b36eeb91c00676ba36aa09aaeb553f51ec186238
Sep 14 09:52:56.165019 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:56.164915    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b687449c8-5s978" event={"ID":"a42757b5-9e6d-47f5-83f4-09662dbfd366","Type":"ContainerStarted","Data":"43af2710d4796c3bf767f4f2f4088a2310f84a729a2698c480427c2b62c8dc9d"}
Sep 14 09:52:56.166751 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:56.166665    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dfbdc546b-tzlgv" event={"ID":"7479590e-8806-4577-bf15-cfdc5cafd92a","Type":"ContainerStarted","Data":"17b740157818540265daf713b36eeb91c00676ba36aa09aaeb553f51ec186238"}
Sep 14 09:52:58.179376 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:58.179339    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dfbdc546b-tzlgv" event={"ID":"7479590e-8806-4577-bf15-cfdc5cafd92a","Type":"ContainerStarted","Data":"ce2f827450b8931f72b1b5fa66c18a95b8d421b5d88bb1dd7023a0431ce83b50"}
Sep 14 09:52:58.179907 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:58.179410    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6dfbdc546b-tzlgv"
Sep 14 09:52:58.181152 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:58.181123    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b687449c8-5s978" event={"ID":"a42757b5-9e6d-47f5-83f4-09662dbfd366","Type":"ContainerStarted","Data":"2986ba9293034a3d6ce0f3b1addc5e1ad89f704ddb91cbca195be10de78407e8"}
Sep 14 09:52:58.181259 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:58.181237    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b687449c8-5s978"
Sep 14 09:52:58.202678 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:58.202621    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6dfbdc546b-tzlgv" podStartSLOduration=1.636016629 podStartE2EDuration="4.202599229s" totalImagesPullingTime="2.5665826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:52:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:52:58.201864969 +0000 UTC m=+594.060097324" watchObservedRunningTime="2026-09-14 09:52:58.202599229 +0000 UTC m=+594.060831587"
Sep 14 09:52:58.224752 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:52:58.224639    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7b687449c8-5s978" podStartSLOduration=2.465888209 podStartE2EDuration="5.224623536s" totalImagesPullingTime="2.758735327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:52:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:52:58.223592129 +0000 UTC m=+594.081824485" watchObservedRunningTime="2026-09-14 09:52:58.224623536 +0000 UTC m=+594.082855891"
Sep 14 09:53:09.187083 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:09.187052    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6dfbdc546b-tzlgv"
Sep 14 09:53:09.187447 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:09.187129    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b687449c8-5s978"
Sep 14 09:53:09.258434 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:09.258395    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b687449c8-5s978"]
Sep 14 09:53:09.258643 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:09.258617    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7b687449c8-5s978" podUID="a42757b5-9e6d-47f5-83f4-09662dbfd366" containerName="manager" containerID="cri-o://2986ba9293034a3d6ce0f3b1addc5e1ad89f704ddb91cbca195be10de78407e8" gracePeriod=30
Sep 14 09:53:09.507422 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:09.507397    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b687449c8-5s978"
Sep 14 09:53:09.677738 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:09.677677    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a42757b5-9e6d-47f5-83f4-09662dbfd366-webhook-cert\") pod \"a42757b5-9e6d-47f5-83f4-09662dbfd366\" (UID: \"a42757b5-9e6d-47f5-83f4-09662dbfd366\") "
Sep 14 09:53:09.677938 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:09.677758    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a42757b5-9e6d-47f5-83f4-09662dbfd366-metrics-certs\") pod \"a42757b5-9e6d-47f5-83f4-09662dbfd366\" (UID: \"a42757b5-9e6d-47f5-83f4-09662dbfd366\") "
Sep 14 09:53:09.677938 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:09.677822    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dhqs\" (UniqueName: \"kubernetes.io/projected/a42757b5-9e6d-47f5-83f4-09662dbfd366-kube-api-access-4dhqs\") pod \"a42757b5-9e6d-47f5-83f4-09662dbfd366\" (UID: \"a42757b5-9e6d-47f5-83f4-09662dbfd366\") "
Sep 14 09:53:09.679977 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:09.679944    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a42757b5-9e6d-47f5-83f4-09662dbfd366-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a42757b5-9e6d-47f5-83f4-09662dbfd366" (UID: "a42757b5-9e6d-47f5-83f4-09662dbfd366"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 09:53:09.680086 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:09.680024    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a42757b5-9e6d-47f5-83f4-09662dbfd366-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a42757b5-9e6d-47f5-83f4-09662dbfd366" (UID: "a42757b5-9e6d-47f5-83f4-09662dbfd366"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 09:53:09.680134 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:09.680078    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a42757b5-9e6d-47f5-83f4-09662dbfd366-kube-api-access-4dhqs" (OuterVolumeSpecName: "kube-api-access-4dhqs") pod "a42757b5-9e6d-47f5-83f4-09662dbfd366" (UID: "a42757b5-9e6d-47f5-83f4-09662dbfd366"). InnerVolumeSpecName "kube-api-access-4dhqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 09:53:09.779205 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:09.779107    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a42757b5-9e6d-47f5-83f4-09662dbfd366-metrics-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:53:09.779205 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:09.779141    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dhqs\" (UniqueName: \"kubernetes.io/projected/a42757b5-9e6d-47f5-83f4-09662dbfd366-kube-api-access-4dhqs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:53:09.779205 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:09.779154    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a42757b5-9e6d-47f5-83f4-09662dbfd366-webhook-cert\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:53:10.242721 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:10.242669    2581 generic.go:356] "Generic (PLEG): container finished" podID="a42757b5-9e6d-47f5-83f4-09662dbfd366" containerID="2986ba9293034a3d6ce0f3b1addc5e1ad89f704ddb91cbca195be10de78407e8" exitCode=0
Sep 14 09:53:10.243141 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:10.242731    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b687449c8-5s978"
Sep 14 09:53:10.243141 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:10.242749    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b687449c8-5s978" event={"ID":"a42757b5-9e6d-47f5-83f4-09662dbfd366","Type":"ContainerDied","Data":"2986ba9293034a3d6ce0f3b1addc5e1ad89f704ddb91cbca195be10de78407e8"}
Sep 14 09:53:10.243141 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:10.242806    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b687449c8-5s978" event={"ID":"a42757b5-9e6d-47f5-83f4-09662dbfd366","Type":"ContainerDied","Data":"43af2710d4796c3bf767f4f2f4088a2310f84a729a2698c480427c2b62c8dc9d"}
Sep 14 09:53:10.243141 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:10.242828    2581 scope.go:117] "RemoveContainer" containerID="2986ba9293034a3d6ce0f3b1addc5e1ad89f704ddb91cbca195be10de78407e8"
Sep 14 09:53:10.252180 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:10.252161    2581 scope.go:117] "RemoveContainer" containerID="2986ba9293034a3d6ce0f3b1addc5e1ad89f704ddb91cbca195be10de78407e8"
Sep 14 09:53:10.252473 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:53:10.252454    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2986ba9293034a3d6ce0f3b1addc5e1ad89f704ddb91cbca195be10de78407e8\": container with ID starting with 2986ba9293034a3d6ce0f3b1addc5e1ad89f704ddb91cbca195be10de78407e8 not found: ID does not exist" containerID="2986ba9293034a3d6ce0f3b1addc5e1ad89f704ddb91cbca195be10de78407e8"
Sep 14 09:53:10.252516 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:10.252482    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2986ba9293034a3d6ce0f3b1addc5e1ad89f704ddb91cbca195be10de78407e8"} err="failed to get container status \"2986ba9293034a3d6ce0f3b1addc5e1ad89f704ddb91cbca195be10de78407e8\": rpc error: code = NotFound desc = could not find container \"2986ba9293034a3d6ce0f3b1addc5e1ad89f704ddb91cbca195be10de78407e8\": container with ID starting with 2986ba9293034a3d6ce0f3b1addc5e1ad89f704ddb91cbca195be10de78407e8 not found: ID does not exist"
Sep 14 09:53:10.267397 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:10.267365    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b687449c8-5s978"]
Sep 14 09:53:10.271738 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:10.271693    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7b687449c8-5s978"]
Sep 14 09:53:10.655653 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:10.655575    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a42757b5-9e6d-47f5-83f4-09662dbfd366" path="/var/lib/kubelet/pods/a42757b5-9e6d-47f5-83f4-09662dbfd366/volumes"
Sep 14 09:53:30.033379 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.033292    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"]
Sep 14 09:53:30.033972 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.033808    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a42757b5-9e6d-47f5-83f4-09662dbfd366" containerName="manager"
Sep 14 09:53:30.033972 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.033828    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a42757b5-9e6d-47f5-83f4-09662dbfd366" containerName="manager"
Sep 14 09:53:30.033972 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.033937    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a42757b5-9e6d-47f5-83f4-09662dbfd366" containerName="manager"
Sep 14 09:53:30.037017 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.036992    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"
Sep 14 09:53:30.039620 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.039599    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 14 09:53:30.039892 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.039872    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 14 09:53:30.041012 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.040979    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-87zkx\""
Sep 14 09:53:30.041118 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.041011    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 14 09:53:30.041118 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.041077    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 14 09:53:30.047146 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.047107    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"]
Sep 14 09:53:30.145139 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.145089    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c964v\" (UniqueName: \"kubernetes.io/projected/893738dd-0720-458d-8ad5-b2b935dd1ddb-kube-api-access-c964v\") pod \"maas-api-769969ccd5-xhgj5\" (UID: \"893738dd-0720-458d-8ad5-b2b935dd1ddb\") " pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"
Sep 14 09:53:30.145139 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.145148    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/893738dd-0720-458d-8ad5-b2b935dd1ddb-openshift-service-ca\") pod \"maas-api-769969ccd5-xhgj5\" (UID: \"893738dd-0720-458d-8ad5-b2b935dd1ddb\") " pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"
Sep 14 09:53:30.145393 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.145232    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/893738dd-0720-458d-8ad5-b2b935dd1ddb-metrics-certs\") pod \"maas-api-769969ccd5-xhgj5\" (UID: \"893738dd-0720-458d-8ad5-b2b935dd1ddb\") " pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"
Sep 14 09:53:30.145393 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.145262    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/893738dd-0720-458d-8ad5-b2b935dd1ddb-maas-api-tls\") pod \"maas-api-769969ccd5-xhgj5\" (UID: \"893738dd-0720-458d-8ad5-b2b935dd1ddb\") " pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"
Sep 14 09:53:30.246488 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.246443    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c964v\" (UniqueName: \"kubernetes.io/projected/893738dd-0720-458d-8ad5-b2b935dd1ddb-kube-api-access-c964v\") pod \"maas-api-769969ccd5-xhgj5\" (UID: \"893738dd-0720-458d-8ad5-b2b935dd1ddb\") " pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"
Sep 14 09:53:30.246703 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.246497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/893738dd-0720-458d-8ad5-b2b935dd1ddb-openshift-service-ca\") pod \"maas-api-769969ccd5-xhgj5\" (UID: \"893738dd-0720-458d-8ad5-b2b935dd1ddb\") " pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"
Sep 14 09:53:30.246703 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.246555    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/893738dd-0720-458d-8ad5-b2b935dd1ddb-metrics-certs\") pod \"maas-api-769969ccd5-xhgj5\" (UID: \"893738dd-0720-458d-8ad5-b2b935dd1ddb\") " pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"
Sep 14 09:53:30.246703 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.246584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/893738dd-0720-458d-8ad5-b2b935dd1ddb-maas-api-tls\") pod \"maas-api-769969ccd5-xhgj5\" (UID: \"893738dd-0720-458d-8ad5-b2b935dd1ddb\") " pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"
Sep 14 09:53:30.247287 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.247267    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/893738dd-0720-458d-8ad5-b2b935dd1ddb-openshift-service-ca\") pod \"maas-api-769969ccd5-xhgj5\" (UID: \"893738dd-0720-458d-8ad5-b2b935dd1ddb\") " pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"
Sep 14 09:53:30.249080 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.249059    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/893738dd-0720-458d-8ad5-b2b935dd1ddb-maas-api-tls\") pod \"maas-api-769969ccd5-xhgj5\" (UID: \"893738dd-0720-458d-8ad5-b2b935dd1ddb\") " pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"
Sep 14 09:53:30.249178 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.249096    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/893738dd-0720-458d-8ad5-b2b935dd1ddb-metrics-certs\") pod \"maas-api-769969ccd5-xhgj5\" (UID: \"893738dd-0720-458d-8ad5-b2b935dd1ddb\") " pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"
Sep 14 09:53:30.256239 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.256208    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c964v\" (UniqueName: \"kubernetes.io/projected/893738dd-0720-458d-8ad5-b2b935dd1ddb-kube-api-access-c964v\") pod \"maas-api-769969ccd5-xhgj5\" (UID: \"893738dd-0720-458d-8ad5-b2b935dd1ddb\") " pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"
Sep 14 09:53:30.348560 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.348466    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"
Sep 14 09:53:30.626105 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.626022    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"]
Sep 14 09:53:30.631471 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:53:30.631443    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod893738dd_0720_458d_8ad5_b2b935dd1ddb.slice/crio-66e60d585cc66e02ec596813410945241e309f8fd154a45b844cdf255e56d84d WatchSource:0}: Error finding container 66e60d585cc66e02ec596813410945241e309f8fd154a45b844cdf255e56d84d: Status 404 returned error can't find the container with id 66e60d585cc66e02ec596813410945241e309f8fd154a45b844cdf255e56d84d
Sep 14 09:53:30.706772 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.706738    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-jtl9g"]
Sep 14 09:53:30.711351 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.711326    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-jtl9g"
Sep 14 09:53:30.714194 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.714166    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 14 09:53:30.714389 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.714282    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-tqx2b\""
Sep 14 09:53:30.721900 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.721870    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-jtl9g"]
Sep 14 09:53:30.751447 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.751412    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvjbz\" (UniqueName: \"kubernetes.io/projected/e9fb2c13-a823-4d31-8633-e79a2affba2d-kube-api-access-tvjbz\") pod \"payload-processing-5b54b7fbb7-jtl9g\" (UID: \"e9fb2c13-a823-4d31-8633-e79a2affba2d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-jtl9g"
Sep 14 09:53:30.751636 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.751475    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9fb2c13-a823-4d31-8633-e79a2affba2d-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-jtl9g\" (UID: \"e9fb2c13-a823-4d31-8633-e79a2affba2d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-jtl9g"
Sep 14 09:53:30.852848 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.852807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvjbz\" (UniqueName: \"kubernetes.io/projected/e9fb2c13-a823-4d31-8633-e79a2affba2d-kube-api-access-tvjbz\") pod \"payload-processing-5b54b7fbb7-jtl9g\" (UID: \"e9fb2c13-a823-4d31-8633-e79a2affba2d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-jtl9g"
Sep 14 09:53:30.853034 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.852870    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9fb2c13-a823-4d31-8633-e79a2affba2d-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-jtl9g\" (UID: \"e9fb2c13-a823-4d31-8633-e79a2affba2d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-jtl9g"
Sep 14 09:53:30.853559 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.853539    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9fb2c13-a823-4d31-8633-e79a2affba2d-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-jtl9g\" (UID: \"e9fb2c13-a823-4d31-8633-e79a2affba2d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-jtl9g"
Sep 14 09:53:30.861795 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:30.861761    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvjbz\" (UniqueName: \"kubernetes.io/projected/e9fb2c13-a823-4d31-8633-e79a2affba2d-kube-api-access-tvjbz\") pod \"payload-processing-5b54b7fbb7-jtl9g\" (UID: \"e9fb2c13-a823-4d31-8633-e79a2affba2d\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-jtl9g"
Sep 14 09:53:31.023967 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:31.023928    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-jtl9g"
Sep 14 09:53:31.298933 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:31.298903    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-jtl9g"]
Sep 14 09:53:31.300959 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:53:31.300925    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9fb2c13_a823_4d31_8633_e79a2affba2d.slice/crio-5cfa3dc2e24ace2c52b9ba11cc22fb414d7091bcad00efe7ebd96db6f772872d WatchSource:0}: Error finding container 5cfa3dc2e24ace2c52b9ba11cc22fb414d7091bcad00efe7ebd96db6f772872d: Status 404 returned error can't find the container with id 5cfa3dc2e24ace2c52b9ba11cc22fb414d7091bcad00efe7ebd96db6f772872d
Sep 14 09:53:31.355674 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:31.355636    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-jtl9g" event={"ID":"e9fb2c13-a823-4d31-8633-e79a2affba2d","Type":"ContainerStarted","Data":"5cfa3dc2e24ace2c52b9ba11cc22fb414d7091bcad00efe7ebd96db6f772872d"}
Sep 14 09:53:31.356867 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:31.356835    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5" event={"ID":"893738dd-0720-458d-8ad5-b2b935dd1ddb","Type":"ContainerStarted","Data":"66e60d585cc66e02ec596813410945241e309f8fd154a45b844cdf255e56d84d"}
Sep 14 09:53:33.368130 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:33.368073    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5" event={"ID":"893738dd-0720-458d-8ad5-b2b935dd1ddb","Type":"ContainerStarted","Data":"1a0d6f3e45dd94c96025ebec8df3af67847530ebaf8d708e5c801dbc1321d29c"}
Sep 14 09:53:33.368617 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:33.368159    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"
Sep 14 09:53:33.369746 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:33.369696    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-jtl9g" event={"ID":"e9fb2c13-a823-4d31-8633-e79a2affba2d","Type":"ContainerStarted","Data":"eca75831d9f918dbdbdf8c120e022a5f7892895f70614e9ac50e088daa632b83"}
Sep 14 09:53:33.369852 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:33.369777    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-jtl9g"
Sep 14 09:53:33.388024 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:33.387978    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5" podStartSLOduration=1.3508009539999999 podStartE2EDuration="3.387959633s" totalImagesPullingTime="2.037158679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:53:33.386389364 +0000 UTC m=+629.244621724" watchObservedRunningTime="2026-09-14 09:53:33.387959633 +0000 UTC m=+629.246191991"
Sep 14 09:53:33.405329 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:33.405277    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-jtl9g" podStartSLOduration=2.035881415 podStartE2EDuration="3.405258864s" totalImagesPullingTime="1.369377449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:53:33.403290507 +0000 UTC m=+629.261522862" watchObservedRunningTime="2026-09-14 09:53:33.405258864 +0000 UTC m=+629.263491224"
Sep 14 09:53:34.277760 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:34.277701    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 09:53:39.380638 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:39.380602    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"
Sep 14 09:53:44.377903 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:44.377865    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-jtl9g"
Sep 14 09:53:44.427329 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:44.427298    2581 generic.go:356] "Generic (PLEG): container finished" podID="58f012c5-1b30-4c57-91dc-8d94ff3f7ee8" containerID="09c6e5aa7d6f1942137271bd3978ba26491c761b62346374456ff5cdff565f28" exitCode=0
Sep 14 09:53:44.427491 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:44.427337    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5" event={"ID":"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8","Type":"ContainerDied","Data":"09c6e5aa7d6f1942137271bd3978ba26491c761b62346374456ff5cdff565f28"}
Sep 14 09:53:44.427794 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:44.427776    2581 scope.go:117] "RemoveContainer" containerID="09c6e5aa7d6f1942137271bd3978ba26491c761b62346374456ff5cdff565f28"
Sep 14 09:53:44.428851 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:44.428825    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 09:53:44.429392 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:44.429335    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 09:53:44.429546 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:44.429521    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 09:53:45.434039 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:45.434000    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5" event={"ID":"58f012c5-1b30-4c57-91dc-8d94ff3f7ee8","Type":"ContainerStarted","Data":"813d7f837609d38261969f8407d6a3f688f615eb08b4d61ce2e42ddf3784d7e5"}
Sep 14 09:53:45.886937 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:45.886846    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:53:45.888157 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:45.888127    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-w9vt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Sep 14 09:53:45.888293 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:45.888204    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5" podUID="58f012c5-1b30-4c57-91dc-8d94ff3f7ee8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Sep 14 09:53:46.887337 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:46.887302    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-w9vt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Sep 14 09:53:46.887754 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:46.887370    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5" podUID="58f012c5-1b30-4c57-91dc-8d94ff3f7ee8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Sep 14 09:53:47.886929 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:47.886889    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-w9vt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Sep 14 09:53:47.887097 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:47.886948    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5" podUID="58f012c5-1b30-4c57-91dc-8d94ff3f7ee8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Sep 14 09:53:47.975839 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:47.975800    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:53:48.887058 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:48.887014    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-w9vt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Sep 14 09:53:48.887236 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:48.887080    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5" podUID="58f012c5-1b30-4c57-91dc-8d94ff3f7ee8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Sep 14 09:53:49.886559 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:49.886516    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-w9vt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Sep 14 09:53:49.887002 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:49.886576    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5" podUID="58f012c5-1b30-4c57-91dc-8d94ff3f7ee8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Sep 14 09:53:50.891470 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:50.891438    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:53:50.892390 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:50.892367    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w9vt5"
Sep 14 09:53:52.323302 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:53:52.323265    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 09:54:15.977893 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:15.977850    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 09:54:24.665565 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.665530    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"]
Sep 14 09:54:24.671287 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.671259    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:24.674568 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.674543    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 14 09:54:24.674568 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.674561    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 14 09:54:24.675725 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.675687    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 14 09:54:24.675816 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.675744    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8sh6p\""
Sep 14 09:54:24.680321 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.680293    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"]
Sep 14 09:54:24.736004 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.735967    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc544e0a-105e-4723-b2ef-6e865cfb8b4b-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg\" (UID: \"bc544e0a-105e-4723-b2ef-6e865cfb8b4b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:24.736188 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.736023    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc544e0a-105e-4723-b2ef-6e865cfb8b4b-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg\" (UID: \"bc544e0a-105e-4723-b2ef-6e865cfb8b4b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:24.736188 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.736087    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc544e0a-105e-4723-b2ef-6e865cfb8b4b-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg\" (UID: \"bc544e0a-105e-4723-b2ef-6e865cfb8b4b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:24.736188 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.736138    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc544e0a-105e-4723-b2ef-6e865cfb8b4b-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg\" (UID: \"bc544e0a-105e-4723-b2ef-6e865cfb8b4b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:24.736188 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.736168    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d668f\" (UniqueName: \"kubernetes.io/projected/bc544e0a-105e-4723-b2ef-6e865cfb8b4b-kube-api-access-d668f\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg\" (UID: \"bc544e0a-105e-4723-b2ef-6e865cfb8b4b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:24.736329 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.736204    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc544e0a-105e-4723-b2ef-6e865cfb8b4b-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg\" (UID: \"bc544e0a-105e-4723-b2ef-6e865cfb8b4b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:24.837193 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.837153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc544e0a-105e-4723-b2ef-6e865cfb8b4b-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg\" (UID: \"bc544e0a-105e-4723-b2ef-6e865cfb8b4b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:24.837389 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.837200    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc544e0a-105e-4723-b2ef-6e865cfb8b4b-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg\" (UID: \"bc544e0a-105e-4723-b2ef-6e865cfb8b4b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:24.837389 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.837232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc544e0a-105e-4723-b2ef-6e865cfb8b4b-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg\" (UID: \"bc544e0a-105e-4723-b2ef-6e865cfb8b4b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:24.837389 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.837264    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d668f\" (UniqueName: \"kubernetes.io/projected/bc544e0a-105e-4723-b2ef-6e865cfb8b4b-kube-api-access-d668f\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg\" (UID: \"bc544e0a-105e-4723-b2ef-6e865cfb8b4b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:24.837389 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.837294    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc544e0a-105e-4723-b2ef-6e865cfb8b4b-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg\" (UID: \"bc544e0a-105e-4723-b2ef-6e865cfb8b4b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:24.837389 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.837351    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc544e0a-105e-4723-b2ef-6e865cfb8b4b-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg\" (UID: \"bc544e0a-105e-4723-b2ef-6e865cfb8b4b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:24.837673 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.837646    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc544e0a-105e-4723-b2ef-6e865cfb8b4b-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg\" (UID: \"bc544e0a-105e-4723-b2ef-6e865cfb8b4b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:24.837673 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.837661    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc544e0a-105e-4723-b2ef-6e865cfb8b4b-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg\" (UID: \"bc544e0a-105e-4723-b2ef-6e865cfb8b4b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:24.837823 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.837683    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc544e0a-105e-4723-b2ef-6e865cfb8b4b-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg\" (UID: \"bc544e0a-105e-4723-b2ef-6e865cfb8b4b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:24.839734 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.839680    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc544e0a-105e-4723-b2ef-6e865cfb8b4b-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg\" (UID: \"bc544e0a-105e-4723-b2ef-6e865cfb8b4b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:24.839971 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.839951    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc544e0a-105e-4723-b2ef-6e865cfb8b4b-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg\" (UID: \"bc544e0a-105e-4723-b2ef-6e865cfb8b4b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:24.852374 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.852345    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d668f\" (UniqueName: \"kubernetes.io/projected/bc544e0a-105e-4723-b2ef-6e865cfb8b4b-kube-api-access-d668f\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg\" (UID: \"bc544e0a-105e-4723-b2ef-6e865cfb8b4b\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:24.982213 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:24.982176    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:25.261220 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:25.261194    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"]
Sep 14 09:54:25.263148 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:54:25.263125    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc544e0a_105e_4723_b2ef_6e865cfb8b4b.slice/crio-07151d8f1505d864302a5b1d86b25f3224f69752354337a8e918284d4f73a0e3 WatchSource:0}: Error finding container 07151d8f1505d864302a5b1d86b25f3224f69752354337a8e918284d4f73a0e3: Status 404 returned error can't find the container with id 07151d8f1505d864302a5b1d86b25f3224f69752354337a8e918284d4f73a0e3
Sep 14 09:54:25.264506 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:25.264486    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 09:54:25.634090 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:25.634000    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg" event={"ID":"bc544e0a-105e-4723-b2ef-6e865cfb8b4b","Type":"ContainerStarted","Data":"07151d8f1505d864302a5b1d86b25f3224f69752354337a8e918284d4f73a0e3"}
Sep 14 09:54:25.775700 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:25.775657    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 09:54:26.640911 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:26.640806    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg" event={"ID":"bc544e0a-105e-4723-b2ef-6e865cfb8b4b","Type":"ContainerStarted","Data":"c56c2199c03db65bf24a3f063ea87a22e0a9b14e6a5ed1b1dab16d7b65ee1162"}
Sep 14 09:54:26.660803 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:26.660746    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg" podStartSLOduration=1.68602935 podStartE2EDuration="2.660729031s" totalImagesPullingTime="974.699681ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:54:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:54:26.660112959 +0000 UTC m=+682.518345315" watchObservedRunningTime="2026-09-14 09:54:26.660729031 +0000 UTC m=+682.518961384"
Sep 14 09:54:34.982530 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:34.982480    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:34.982981 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:34.982563    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:34.995267 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:34.995240    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:35.696020 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:35.695992    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg"
Sep 14 09:54:38.692733 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:38.692677    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 09:54:44.464520 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.464480    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"]
Sep 14 09:54:44.468178 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.468146    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:44.471497 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.471473    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 14 09:54:44.482324 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.482302    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"]
Sep 14 09:54:44.621044 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.620953    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efbef168-639f-467f-9c94-815b442de5a8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98\" (UID: \"efbef168-639f-467f-9c94-815b442de5a8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:44.621044 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.621014    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efbef168-639f-467f-9c94-815b442de5a8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98\" (UID: \"efbef168-639f-467f-9c94-815b442de5a8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:44.621276 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.621092    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efbef168-639f-467f-9c94-815b442de5a8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98\" (UID: \"efbef168-639f-467f-9c94-815b442de5a8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:44.621276 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.621159    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efbef168-639f-467f-9c94-815b442de5a8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98\" (UID: \"efbef168-639f-467f-9c94-815b442de5a8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:44.621276 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.621202    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blnfx\" (UniqueName: \"kubernetes.io/projected/efbef168-639f-467f-9c94-815b442de5a8-kube-api-access-blnfx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98\" (UID: \"efbef168-639f-467f-9c94-815b442de5a8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:44.621276 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.621237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efbef168-639f-467f-9c94-815b442de5a8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98\" (UID: \"efbef168-639f-467f-9c94-815b442de5a8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:44.722504 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.722465    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efbef168-639f-467f-9c94-815b442de5a8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98\" (UID: \"efbef168-639f-467f-9c94-815b442de5a8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:44.722667 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.722523    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blnfx\" (UniqueName: \"kubernetes.io/projected/efbef168-639f-467f-9c94-815b442de5a8-kube-api-access-blnfx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98\" (UID: \"efbef168-639f-467f-9c94-815b442de5a8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:44.722667 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.722553    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efbef168-639f-467f-9c94-815b442de5a8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98\" (UID: \"efbef168-639f-467f-9c94-815b442de5a8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:44.722667 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.722578    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efbef168-639f-467f-9c94-815b442de5a8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98\" (UID: \"efbef168-639f-467f-9c94-815b442de5a8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:44.722667 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.722609    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efbef168-639f-467f-9c94-815b442de5a8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98\" (UID: \"efbef168-639f-467f-9c94-815b442de5a8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:44.722667 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.722637    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efbef168-639f-467f-9c94-815b442de5a8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98\" (UID: \"efbef168-639f-467f-9c94-815b442de5a8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:44.723079 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.723055    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efbef168-639f-467f-9c94-815b442de5a8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98\" (UID: \"efbef168-639f-467f-9c94-815b442de5a8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:44.723141 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.723114    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efbef168-639f-467f-9c94-815b442de5a8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98\" (UID: \"efbef168-639f-467f-9c94-815b442de5a8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:44.723191 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.723142    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efbef168-639f-467f-9c94-815b442de5a8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98\" (UID: \"efbef168-639f-467f-9c94-815b442de5a8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:44.724965 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.724939    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efbef168-639f-467f-9c94-815b442de5a8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98\" (UID: \"efbef168-639f-467f-9c94-815b442de5a8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:44.725117 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.725101    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efbef168-639f-467f-9c94-815b442de5a8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98\" (UID: \"efbef168-639f-467f-9c94-815b442de5a8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:44.733102 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.733080    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blnfx\" (UniqueName: \"kubernetes.io/projected/efbef168-639f-467f-9c94-815b442de5a8-kube-api-access-blnfx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98\" (UID: \"efbef168-639f-467f-9c94-815b442de5a8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:44.779111 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:44.779082    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:45.057908 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:45.057881    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"]
Sep 14 09:54:45.059668 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:54:45.059639    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefbef168_639f_467f_9c94_815b442de5a8.slice/crio-3f4152e74bea0deedd087b48f438fb1db16284350011399e62e46eee0e8e291c WatchSource:0}: Error finding container 3f4152e74bea0deedd087b48f438fb1db16284350011399e62e46eee0e8e291c: Status 404 returned error can't find the container with id 3f4152e74bea0deedd087b48f438fb1db16284350011399e62e46eee0e8e291c
Sep 14 09:54:45.742237 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:45.742202    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98" event={"ID":"efbef168-639f-467f-9c94-815b442de5a8","Type":"ContainerStarted","Data":"0795ef91bdcea5ce1aec8fe489b6a11d80434427e9aa5b443c29a2806b2112b1"}
Sep 14 09:54:45.742631 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:45.742256    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98" event={"ID":"efbef168-639f-467f-9c94-815b442de5a8","Type":"ContainerStarted","Data":"3f4152e74bea0deedd087b48f438fb1db16284350011399e62e46eee0e8e291c"}
Sep 14 09:54:45.794448 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:45.794391    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98" podStartSLOduration=1.617385541 podStartE2EDuration="1.794370947s" totalImagesPullingTime="176.985406ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:54:45.793693266 +0000 UTC m=+701.651925622" watchObservedRunningTime="2026-09-14 09:54:45.794370947 +0000 UTC m=+701.652603303"
Sep 14 09:54:46.009575 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:46.009489    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 09:54:54.460940 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.460896    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"]
Sep 14 09:54:54.464665 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.464641    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:54:54.467538 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.467515    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 14 09:54:54.480454 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.480429    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"]
Sep 14 09:54:54.509490 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.509452    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bc1859e-7308-4619-bde2-66b4a0de4319-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4979g\" (UID: \"5bc1859e-7308-4619-bde2-66b4a0de4319\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:54:54.509751 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.509700    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65n4s\" (UniqueName: \"kubernetes.io/projected/5bc1859e-7308-4619-bde2-66b4a0de4319-kube-api-access-65n4s\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4979g\" (UID: \"5bc1859e-7308-4619-bde2-66b4a0de4319\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:54:54.509859 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.509792    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bc1859e-7308-4619-bde2-66b4a0de4319-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4979g\" (UID: \"5bc1859e-7308-4619-bde2-66b4a0de4319\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:54:54.509859 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.509816    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bc1859e-7308-4619-bde2-66b4a0de4319-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4979g\" (UID: \"5bc1859e-7308-4619-bde2-66b4a0de4319\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:54:54.509859 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.509846    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bc1859e-7308-4619-bde2-66b4a0de4319-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4979g\" (UID: \"5bc1859e-7308-4619-bde2-66b4a0de4319\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:54:54.510017 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.509909    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bc1859e-7308-4619-bde2-66b4a0de4319-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4979g\" (UID: \"5bc1859e-7308-4619-bde2-66b4a0de4319\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:54:54.611183 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.611145    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65n4s\" (UniqueName: \"kubernetes.io/projected/5bc1859e-7308-4619-bde2-66b4a0de4319-kube-api-access-65n4s\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4979g\" (UID: \"5bc1859e-7308-4619-bde2-66b4a0de4319\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:54:54.611365 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.611204    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bc1859e-7308-4619-bde2-66b4a0de4319-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4979g\" (UID: \"5bc1859e-7308-4619-bde2-66b4a0de4319\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:54:54.611441 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.611395    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bc1859e-7308-4619-bde2-66b4a0de4319-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4979g\" (UID: \"5bc1859e-7308-4619-bde2-66b4a0de4319\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:54:54.611502 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.611441    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bc1859e-7308-4619-bde2-66b4a0de4319-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4979g\" (UID: \"5bc1859e-7308-4619-bde2-66b4a0de4319\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:54:54.611592 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.611564    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bc1859e-7308-4619-bde2-66b4a0de4319-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4979g\" (UID: \"5bc1859e-7308-4619-bde2-66b4a0de4319\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:54:54.611741 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.611697    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bc1859e-7308-4619-bde2-66b4a0de4319-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4979g\" (UID: \"5bc1859e-7308-4619-bde2-66b4a0de4319\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:54:54.611886 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.611767    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bc1859e-7308-4619-bde2-66b4a0de4319-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4979g\" (UID: \"5bc1859e-7308-4619-bde2-66b4a0de4319\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:54:54.611886 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.611836    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bc1859e-7308-4619-bde2-66b4a0de4319-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4979g\" (UID: \"5bc1859e-7308-4619-bde2-66b4a0de4319\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:54:54.612013 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.611989    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bc1859e-7308-4619-bde2-66b4a0de4319-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4979g\" (UID: \"5bc1859e-7308-4619-bde2-66b4a0de4319\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:54:54.614113 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.614084    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bc1859e-7308-4619-bde2-66b4a0de4319-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4979g\" (UID: \"5bc1859e-7308-4619-bde2-66b4a0de4319\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:54:54.614232 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.614139    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bc1859e-7308-4619-bde2-66b4a0de4319-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4979g\" (UID: \"5bc1859e-7308-4619-bde2-66b4a0de4319\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:54:54.620231 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.620204    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65n4s\" (UniqueName: \"kubernetes.io/projected/5bc1859e-7308-4619-bde2-66b4a0de4319-kube-api-access-65n4s\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4979g\" (UID: \"5bc1859e-7308-4619-bde2-66b4a0de4319\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:54:54.775630 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.775526    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:54:54.779775 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.779745    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:54.779867 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.779810    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:54.795576 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.795387    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:54.809951 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:54.809924    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98"
Sep 14 09:54:55.059412 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:55.059297    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"]
Sep 14 09:54:55.062298 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:54:55.062271    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc1859e_7308_4619_bde2_66b4a0de4319.slice/crio-280ee0966d3bae9b2ac7b6d0a4da892e70c85a34f870c629d7097ef05ac8a693 WatchSource:0}: Error finding container 280ee0966d3bae9b2ac7b6d0a4da892e70c85a34f870c629d7097ef05ac8a693: Status 404 returned error can't find the container with id 280ee0966d3bae9b2ac7b6d0a4da892e70c85a34f870c629d7097ef05ac8a693
Sep 14 09:54:55.793864 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:55.793820    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g" event={"ID":"5bc1859e-7308-4619-bde2-66b4a0de4319","Type":"ContainerStarted","Data":"861d082fc98b868db970d44de4c82395f53e6c26d9c905e51c9b9e84546ee6f0"}
Sep 14 09:54:55.794300 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:55.793888    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g" event={"ID":"5bc1859e-7308-4619-bde2-66b4a0de4319","Type":"ContainerStarted","Data":"280ee0966d3bae9b2ac7b6d0a4da892e70c85a34f870c629d7097ef05ac8a693"}
Sep 14 09:54:55.817248 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:55.817188    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g" podStartSLOduration=1.644455459 podStartE2EDuration="1.817169049s" totalImagesPullingTime="172.71359ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:54:55.81556042 +0000 UTC m=+711.673792808" watchObservedRunningTime="2026-09-14 09:54:55.817169049 +0000 UTC m=+711.675401406"
Sep 14 09:54:56.304056 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:54:56.304016    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 09:55:04.776096 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:04.776057    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:55:04.776556 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:04.776117    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:55:04.789472 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:04.789443    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:55:04.848392 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:04.848355    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4979g"
Sep 14 09:55:05.753361 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.753325    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"]
Sep 14 09:55:05.760277 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.760251    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:05.763015 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.762990    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 14 09:55:05.766603 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.766578    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"]
Sep 14 09:55:05.809966 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.809923    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f\" (UID: \"e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:05.810457 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.809993    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p724\" (UniqueName: \"kubernetes.io/projected/e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4-kube-api-access-9p724\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f\" (UID: \"e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:05.810457 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.810028    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f\" (UID: \"e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:05.810457 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.810177    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f\" (UID: \"e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:05.810457 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.810210    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f\" (UID: \"e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:05.810457 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.810241    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f\" (UID: \"e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:05.911750 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.911693    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f\" (UID: \"e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:05.911935 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.911759    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p724\" (UniqueName: \"kubernetes.io/projected/e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4-kube-api-access-9p724\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f\" (UID: \"e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:05.911935 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.911785    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f\" (UID: \"e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:05.911935 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.911871    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f\" (UID: \"e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:05.911935 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.911899    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f\" (UID: \"e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:05.911935 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.911919    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f\" (UID: \"e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:05.912195 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.912157    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f\" (UID: \"e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:05.912382 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.912361    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f\" (UID: \"e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:05.912479 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.912424    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f\" (UID: \"e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:05.914905 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.914883    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f\" (UID: \"e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:05.915051 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.915036    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f\" (UID: \"e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:05.920364 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:05.920339    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p724\" (UniqueName: \"kubernetes.io/projected/e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4-kube-api-access-9p724\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f\" (UID: \"e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:06.071312 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:06.071223    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:06.343797 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:06.343765    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"]
Sep 14 09:55:06.346489 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:55:06.346454    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4fb5fff_5b56_4cc1_aaa9_50dc23056cf4.slice/crio-6978a02cadbd5729a18f20a000529a27868e90c1bbfd60ded2f0f2d0a0c07449 WatchSource:0}: Error finding container 6978a02cadbd5729a18f20a000529a27868e90c1bbfd60ded2f0f2d0a0c07449: Status 404 returned error can't find the container with id 6978a02cadbd5729a18f20a000529a27868e90c1bbfd60ded2f0f2d0a0c07449
Sep 14 09:55:06.848655 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:06.848615    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f" event={"ID":"e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4","Type":"ContainerStarted","Data":"a49b91e247692b48611505db36f5c8562236235165bb47d3384bbfc594856949"}
Sep 14 09:55:06.848655 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:06.848663    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f" event={"ID":"e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4","Type":"ContainerStarted","Data":"6978a02cadbd5729a18f20a000529a27868e90c1bbfd60ded2f0f2d0a0c07449"}
Sep 14 09:55:06.870446 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:06.870323    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f" podStartSLOduration=1.666206396 podStartE2EDuration="1.870303303s" totalImagesPullingTime="204.096907ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:55:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:55:06.869940571 +0000 UTC m=+722.728172928" watchObservedRunningTime="2026-09-14 09:55:06.870303303 +0000 UTC m=+722.728535693"
Sep 14 09:55:07.901517 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:07.901474    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 09:55:16.071963 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:16.071918    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:16.072468 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:16.071978    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:16.084515 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:16.084486    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:55:16.911419 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:55:16.911385    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f"
Sep 14 09:57:23.692740 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:23.692688    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 09:57:27.408098 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:27.408059    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"]
Sep 14 09:57:27.411822 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:27.411800    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"
Sep 14 09:57:27.415345 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:27.415321    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-b6812e-serving-cert\""
Sep 14 09:57:27.423679 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:27.423646    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"]
Sep 14 09:57:27.509517 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:27.509482    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kn2f\" (UniqueName: \"kubernetes.io/projected/5197ca13-8f47-40d9-a297-fb2ab1f02899-kube-api-access-5kn2f\") pod \"maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg\" (UID: \"5197ca13-8f47-40d9-a297-fb2ab1f02899\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"
Sep 14 09:57:27.509762 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:27.509553    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5197ca13-8f47-40d9-a297-fb2ab1f02899-maas-api-tls\") pod \"maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg\" (UID: \"5197ca13-8f47-40d9-a297-fb2ab1f02899\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"
Sep 14 09:57:27.509762 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:27.509604    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5197ca13-8f47-40d9-a297-fb2ab1f02899-metrics-certs\") pod \"maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg\" (UID: \"5197ca13-8f47-40d9-a297-fb2ab1f02899\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"
Sep 14 09:57:27.509848 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:27.509751    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5197ca13-8f47-40d9-a297-fb2ab1f02899-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg\" (UID: \"5197ca13-8f47-40d9-a297-fb2ab1f02899\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"
Sep 14 09:57:27.611181 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:27.611143    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5197ca13-8f47-40d9-a297-fb2ab1f02899-maas-api-tls\") pod \"maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg\" (UID: \"5197ca13-8f47-40d9-a297-fb2ab1f02899\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"
Sep 14 09:57:27.611369 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:27.611190    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5197ca13-8f47-40d9-a297-fb2ab1f02899-metrics-certs\") pod \"maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg\" (UID: \"5197ca13-8f47-40d9-a297-fb2ab1f02899\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"
Sep 14 09:57:27.611369 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:27.611241    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5197ca13-8f47-40d9-a297-fb2ab1f02899-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg\" (UID: \"5197ca13-8f47-40d9-a297-fb2ab1f02899\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"
Sep 14 09:57:27.611369 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:27.611270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kn2f\" (UniqueName: \"kubernetes.io/projected/5197ca13-8f47-40d9-a297-fb2ab1f02899-kube-api-access-5kn2f\") pod \"maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg\" (UID: \"5197ca13-8f47-40d9-a297-fb2ab1f02899\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"
Sep 14 09:57:27.611992 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:27.611966    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5197ca13-8f47-40d9-a297-fb2ab1f02899-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg\" (UID: \"5197ca13-8f47-40d9-a297-fb2ab1f02899\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"
Sep 14 09:57:27.613701 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:27.613680    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5197ca13-8f47-40d9-a297-fb2ab1f02899-metrics-certs\") pod \"maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg\" (UID: \"5197ca13-8f47-40d9-a297-fb2ab1f02899\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"
Sep 14 09:57:27.613817 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:27.613748    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5197ca13-8f47-40d9-a297-fb2ab1f02899-maas-api-tls\") pod \"maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg\" (UID: \"5197ca13-8f47-40d9-a297-fb2ab1f02899\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"
Sep 14 09:57:27.620763 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:27.620734    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kn2f\" (UniqueName: \"kubernetes.io/projected/5197ca13-8f47-40d9-a297-fb2ab1f02899-kube-api-access-5kn2f\") pod \"maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg\" (UID: \"5197ca13-8f47-40d9-a297-fb2ab1f02899\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"
Sep 14 09:57:27.723145 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:27.723103    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"
Sep 14 09:57:28.006204 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:28.006119    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"]
Sep 14 09:57:28.010340 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:57:28.010309    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5197ca13_8f47_40d9_a297_fb2ab1f02899.slice/crio-4d058b629cc6b9bf4d65bdf6a0faa31cadcebfc0b417210c9b3559b9bdc7faec WatchSource:0}: Error finding container 4d058b629cc6b9bf4d65bdf6a0faa31cadcebfc0b417210c9b3559b9bdc7faec: Status 404 returned error can't find the container with id 4d058b629cc6b9bf4d65bdf6a0faa31cadcebfc0b417210c9b3559b9bdc7faec
Sep 14 09:57:28.577293 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:28.577257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg" event={"ID":"5197ca13-8f47-40d9-a297-fb2ab1f02899","Type":"ContainerStarted","Data":"7d143a9a4f7c482ee74feb264cfb3746d0eae17dd1c5505c2cc7189ed8c596eb"}
Sep 14 09:57:28.577744 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:28.577313    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg" event={"ID":"5197ca13-8f47-40d9-a297-fb2ab1f02899","Type":"ContainerStarted","Data":"4d058b629cc6b9bf4d65bdf6a0faa31cadcebfc0b417210c9b3559b9bdc7faec"}
Sep 14 09:57:28.577744 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:28.577398    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"
Sep 14 09:57:28.609596 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:28.609512    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg" podStartSLOduration=1.248330632 podStartE2EDuration="1.60949133s" totalImagesPullingTime="361.160698ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:57:28.607618781 +0000 UTC m=+864.465851138" watchObservedRunningTime="2026-09-14 09:57:28.60949133 +0000 UTC m=+864.467723687"
Sep 14 09:57:28.810222 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:28.810186    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"]
Sep 14 09:57:28.813875 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:28.813844    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"
Sep 14 09:57:28.816774 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:28.816746    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-2901ec-serving-cert\""
Sep 14 09:57:28.835899 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:28.835862    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"]
Sep 14 09:57:28.925085 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:28.925046    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-maas-api-tls\") pod \"maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg\" (UID: \"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"
Sep 14 09:57:28.925085 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:28.925087    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg\" (UID: \"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"
Sep 14 09:57:28.925323 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:28.925176    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-metrics-certs\") pod \"maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg\" (UID: \"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"
Sep 14 09:57:28.925323 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:28.925209    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cshq7\" (UniqueName: \"kubernetes.io/projected/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-kube-api-access-cshq7\") pod \"maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg\" (UID: \"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"
Sep 14 09:57:29.026211 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:29.026170    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-maas-api-tls\") pod \"maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg\" (UID: \"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"
Sep 14 09:57:29.026211 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:29.026214    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg\" (UID: \"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"
Sep 14 09:57:29.026457 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:29.026280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-metrics-certs\") pod \"maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg\" (UID: \"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"
Sep 14 09:57:29.026457 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:29.026305    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cshq7\" (UniqueName: \"kubernetes.io/projected/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-kube-api-access-cshq7\") pod \"maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg\" (UID: \"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"
Sep 14 09:57:29.026457 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:57:29.026331    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-serving-cert: secret "maas-api-e2e-worker-w4-2901ec-serving-cert" not found
Sep 14 09:57:29.026457 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:57:29.026405    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-maas-api-tls podName:d53e8b31-b1b9-4c4c-99b2-8212c9078b4d nodeName:}" failed. No retries permitted until 2026-09-14 09:57:29.526383273 +0000 UTC m=+865.384615625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-maas-api-tls") pod "maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg" (UID: "d53e8b31-b1b9-4c4c-99b2-8212c9078b4d") : secret "maas-api-e2e-worker-w4-2901ec-serving-cert" not found
Sep 14 09:57:29.027061 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:29.027037    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg\" (UID: \"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"
Sep 14 09:57:29.028932 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:29.028913    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-metrics-certs\") pod \"maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg\" (UID: \"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"
Sep 14 09:57:29.040558 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:29.040530    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cshq7\" (UniqueName: \"kubernetes.io/projected/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-kube-api-access-cshq7\") pod \"maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg\" (UID: \"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"
Sep 14 09:57:29.531940 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:29.531906    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-maas-api-tls\") pod \"maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg\" (UID: \"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"
Sep 14 09:57:29.534653 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:29.534622    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-maas-api-tls\") pod \"maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg\" (UID: \"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"
Sep 14 09:57:29.725732 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:29.725665    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"
Sep 14 09:57:30.081703 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:30.081618    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"]
Sep 14 09:57:30.085647 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:57:30.085608    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53e8b31_b1b9_4c4c_99b2_8212c9078b4d.slice/crio-87e33f3a1626827f6a1cec66c64839f4684d75b51a90e1a205d1f25affdd85df WatchSource:0}: Error finding container 87e33f3a1626827f6a1cec66c64839f4684d75b51a90e1a205d1f25affdd85df: Status 404 returned error can't find the container with id 87e33f3a1626827f6a1cec66c64839f4684d75b51a90e1a205d1f25affdd85df
Sep 14 09:57:30.589257 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:30.589218    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg" event={"ID":"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d","Type":"ContainerStarted","Data":"87e33f3a1626827f6a1cec66c64839f4684d75b51a90e1a205d1f25affdd85df"}
Sep 14 09:57:31.596617 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:31.596571    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg" event={"ID":"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d","Type":"ContainerStarted","Data":"681229f9318fd76c393a8afa1c03e6477df26ace9e3da025f712ad6012cc3c20"}
Sep 14 09:57:31.597086 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:31.596756    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"
Sep 14 09:57:31.626904 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:31.626838    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg" podStartSLOduration=3.167685548 podStartE2EDuration="3.626817728s" totalImagesPullingTime="459.13218ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:57:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:57:31.624820916 +0000 UTC m=+867.483053272" watchObservedRunningTime="2026-09-14 09:57:31.626817728 +0000 UTC m=+867.485050085"
Sep 14 09:57:33.454743 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:33.454676    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 09:57:34.588730 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:34.588684    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"
Sep 14 09:57:37.608496 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:37.608462    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"
Sep 14 09:57:38.183903 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:38.183854    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"]
Sep 14 09:57:38.187815 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:38.187785    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"
Sep 14 09:57:38.190835 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:38.190802    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-8c98aa-serving-cert\""
Sep 14 09:57:38.198779 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:38.198746    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"]
Sep 14 09:57:38.320099 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:38.320062    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c14846d-0cce-4a56-ba26-1c75b32172cc-metrics-certs\") pod \"maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d\" (UID: \"2c14846d-0cce-4a56-ba26-1c75b32172cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"
Sep 14 09:57:38.320268 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:38.320245    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c14846d-0cce-4a56-ba26-1c75b32172cc-openshift-service-ca\") pod \"maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d\" (UID: \"2c14846d-0cce-4a56-ba26-1c75b32172cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"
Sep 14 09:57:38.320320 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:38.320286    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws9fw\" (UniqueName: \"kubernetes.io/projected/2c14846d-0cce-4a56-ba26-1c75b32172cc-kube-api-access-ws9fw\") pod \"maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d\" (UID: \"2c14846d-0cce-4a56-ba26-1c75b32172cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"
Sep 14 09:57:38.320383 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:38.320373    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c14846d-0cce-4a56-ba26-1c75b32172cc-maas-api-tls\") pod \"maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d\" (UID: \"2c14846d-0cce-4a56-ba26-1c75b32172cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"
Sep 14 09:57:38.421696 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:38.421659    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c14846d-0cce-4a56-ba26-1c75b32172cc-openshift-service-ca\") pod \"maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d\" (UID: \"2c14846d-0cce-4a56-ba26-1c75b32172cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"
Sep 14 09:57:38.421696 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:38.421694    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws9fw\" (UniqueName: \"kubernetes.io/projected/2c14846d-0cce-4a56-ba26-1c75b32172cc-kube-api-access-ws9fw\") pod \"maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d\" (UID: \"2c14846d-0cce-4a56-ba26-1c75b32172cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"
Sep 14 09:57:38.421982 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:38.421754    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c14846d-0cce-4a56-ba26-1c75b32172cc-maas-api-tls\") pod \"maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d\" (UID: \"2c14846d-0cce-4a56-ba26-1c75b32172cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"
Sep 14 09:57:38.421982 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:38.421783    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c14846d-0cce-4a56-ba26-1c75b32172cc-metrics-certs\") pod \"maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d\" (UID: \"2c14846d-0cce-4a56-ba26-1c75b32172cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"
Sep 14 09:57:38.421982 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:57:38.421893    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-serving-cert: secret "maas-api-e2e-autores-8c98aa-serving-cert" not found
Sep 14 09:57:38.421982 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:57:38.421971    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c14846d-0cce-4a56-ba26-1c75b32172cc-maas-api-tls podName:2c14846d-0cce-4a56-ba26-1c75b32172cc nodeName:}" failed. No retries permitted until 2026-09-14 09:57:38.921954122 +0000 UTC m=+874.780186456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2c14846d-0cce-4a56-ba26-1c75b32172cc-maas-api-tls") pod "maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d" (UID: "2c14846d-0cce-4a56-ba26-1c75b32172cc") : secret "maas-api-e2e-autores-8c98aa-serving-cert" not found
Sep 14 09:57:38.422499 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:38.422475    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c14846d-0cce-4a56-ba26-1c75b32172cc-openshift-service-ca\") pod \"maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d\" (UID: \"2c14846d-0cce-4a56-ba26-1c75b32172cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"
Sep 14 09:57:38.424406 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:38.424386    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c14846d-0cce-4a56-ba26-1c75b32172cc-metrics-certs\") pod \"maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d\" (UID: \"2c14846d-0cce-4a56-ba26-1c75b32172cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"
Sep 14 09:57:38.433699 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:38.433665    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws9fw\" (UniqueName: \"kubernetes.io/projected/2c14846d-0cce-4a56-ba26-1c75b32172cc-kube-api-access-ws9fw\") pod \"maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d\" (UID: \"2c14846d-0cce-4a56-ba26-1c75b32172cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"
Sep 14 09:57:38.926357 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:38.926323    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c14846d-0cce-4a56-ba26-1c75b32172cc-maas-api-tls\") pod \"maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d\" (UID: \"2c14846d-0cce-4a56-ba26-1c75b32172cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"
Sep 14 09:57:38.928874 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:38.928844    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c14846d-0cce-4a56-ba26-1c75b32172cc-maas-api-tls\") pod \"maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d\" (UID: \"2c14846d-0cce-4a56-ba26-1c75b32172cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"
Sep 14 09:57:39.100151 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.100115    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"
Sep 14 09:57:39.341590 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.341552    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx"]
Sep 14 09:57:39.346488 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.346464    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx"
Sep 14 09:57:39.349805 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.349780    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-8c98aa-dockercfg-72ssd\""
Sep 14 09:57:39.350433 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.350411    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-8c98aa\""
Sep 14 09:57:39.357063 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.357029    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx"]
Sep 14 09:57:39.384185 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.384156    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"]
Sep 14 09:57:39.385109 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:57:39.385078    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c14846d_0cce_4a56_ba26_1c75b32172cc.slice/crio-45f92c91336b3e847a568fd204d8a59a79a76cc2cddcdf2738a65a53eb019a81 WatchSource:0}: Error finding container 45f92c91336b3e847a568fd204d8a59a79a76cc2cddcdf2738a65a53eb019a81: Status 404 returned error can't find the container with id 45f92c91336b3e847a568fd204d8a59a79a76cc2cddcdf2738a65a53eb019a81
Sep 14 09:57:39.431168 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.431034    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a0e0f04-6847-4730-afcb-d04c7a21207e-plugins-config-volume\") pod \"payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx\" (UID: \"6a0e0f04-6847-4730-afcb-d04c7a21207e\") " pod="openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx"
Sep 14 09:57:39.431168 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.431108    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7srmv\" (UniqueName: \"kubernetes.io/projected/6a0e0f04-6847-4730-afcb-d04c7a21207e-kube-api-access-7srmv\") pod \"payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx\" (UID: \"6a0e0f04-6847-4730-afcb-d04c7a21207e\") " pod="openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx"
Sep 14 09:57:39.532115 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.532075    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a0e0f04-6847-4730-afcb-d04c7a21207e-plugins-config-volume\") pod \"payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx\" (UID: \"6a0e0f04-6847-4730-afcb-d04c7a21207e\") " pod="openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx"
Sep 14 09:57:39.532293 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.532127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7srmv\" (UniqueName: \"kubernetes.io/projected/6a0e0f04-6847-4730-afcb-d04c7a21207e-kube-api-access-7srmv\") pod \"payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx\" (UID: \"6a0e0f04-6847-4730-afcb-d04c7a21207e\") " pod="openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx"
Sep 14 09:57:39.532923 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.532901    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a0e0f04-6847-4730-afcb-d04c7a21207e-plugins-config-volume\") pod \"payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx\" (UID: \"6a0e0f04-6847-4730-afcb-d04c7a21207e\") " pod="openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx"
Sep 14 09:57:39.543087 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.543049    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7srmv\" (UniqueName: \"kubernetes.io/projected/6a0e0f04-6847-4730-afcb-d04c7a21207e-kube-api-access-7srmv\") pod \"payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx\" (UID: \"6a0e0f04-6847-4730-afcb-d04c7a21207e\") " pod="openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx"
Sep 14 09:57:39.566285 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.566250    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"]
Sep 14 09:57:39.571071 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.571046    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"
Sep 14 09:57:39.574673 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.574625    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-9eed367b-serving-cert\""
Sep 14 09:57:39.589093 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.589061    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"]
Sep 14 09:57:39.644765 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.644657    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d" event={"ID":"2c14846d-0cce-4a56-ba26-1c75b32172cc","Type":"ContainerStarted","Data":"45f92c91336b3e847a568fd204d8a59a79a76cc2cddcdf2738a65a53eb019a81"}
Sep 14 09:57:39.659331 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.659293    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx"
Sep 14 09:57:39.734327 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.734291    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83ecf2bf-00d5-4fff-84fc-e9433710e304-openshift-service-ca\") pod \"maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn\" (UID: \"83ecf2bf-00d5-4fff-84fc-e9433710e304\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"
Sep 14 09:57:39.734512 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.734347    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fvsf\" (UniqueName: \"kubernetes.io/projected/83ecf2bf-00d5-4fff-84fc-e9433710e304-kube-api-access-7fvsf\") pod \"maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn\" (UID: \"83ecf2bf-00d5-4fff-84fc-e9433710e304\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"
Sep 14 09:57:39.734579 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.734511    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83ecf2bf-00d5-4fff-84fc-e9433710e304-metrics-certs\") pod \"maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn\" (UID: \"83ecf2bf-00d5-4fff-84fc-e9433710e304\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"
Sep 14 09:57:39.734633 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.734599    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83ecf2bf-00d5-4fff-84fc-e9433710e304-maas-api-tls\") pod \"maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn\" (UID: \"83ecf2bf-00d5-4fff-84fc-e9433710e304\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"
Sep 14 09:57:39.836296 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.836268    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83ecf2bf-00d5-4fff-84fc-e9433710e304-maas-api-tls\") pod \"maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn\" (UID: \"83ecf2bf-00d5-4fff-84fc-e9433710e304\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"
Sep 14 09:57:39.836427 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.836340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83ecf2bf-00d5-4fff-84fc-e9433710e304-openshift-service-ca\") pod \"maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn\" (UID: \"83ecf2bf-00d5-4fff-84fc-e9433710e304\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"
Sep 14 09:57:39.836427 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.836377    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fvsf\" (UniqueName: \"kubernetes.io/projected/83ecf2bf-00d5-4fff-84fc-e9433710e304-kube-api-access-7fvsf\") pod \"maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn\" (UID: \"83ecf2bf-00d5-4fff-84fc-e9433710e304\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"
Sep 14 09:57:39.836543 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.836441    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83ecf2bf-00d5-4fff-84fc-e9433710e304-metrics-certs\") pod \"maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn\" (UID: \"83ecf2bf-00d5-4fff-84fc-e9433710e304\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"
Sep 14 09:57:39.837289 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.837260    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83ecf2bf-00d5-4fff-84fc-e9433710e304-openshift-service-ca\") pod \"maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn\" (UID: \"83ecf2bf-00d5-4fff-84fc-e9433710e304\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"
Sep 14 09:57:39.839224 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.839195    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83ecf2bf-00d5-4fff-84fc-e9433710e304-metrics-certs\") pod \"maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn\" (UID: \"83ecf2bf-00d5-4fff-84fc-e9433710e304\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"
Sep 14 09:57:39.839835 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.839817    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83ecf2bf-00d5-4fff-84fc-e9433710e304-maas-api-tls\") pod \"maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn\" (UID: \"83ecf2bf-00d5-4fff-84fc-e9433710e304\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"
Sep 14 09:57:39.863369 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.863338    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fvsf\" (UniqueName: \"kubernetes.io/projected/83ecf2bf-00d5-4fff-84fc-e9433710e304-kube-api-access-7fvsf\") pod \"maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn\" (UID: \"83ecf2bf-00d5-4fff-84fc-e9433710e304\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"
Sep 14 09:57:39.882592 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.882550    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"
Sep 14 09:57:39.985047 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:57:39.985005    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a0e0f04_6847_4730_afcb_d04c7a21207e.slice/crio-83f38688ca2730d11f39ee65d677f57cf87519f35d138d24b7d84881d8c0ecc9 WatchSource:0}: Error finding container 83f38688ca2730d11f39ee65d677f57cf87519f35d138d24b7d84881d8c0ecc9: Status 404 returned error can't find the container with id 83f38688ca2730d11f39ee65d677f57cf87519f35d138d24b7d84881d8c0ecc9
Sep 14 09:57:39.987401 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:39.987335    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx"]
Sep 14 09:57:40.190229 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:40.190196    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"]
Sep 14 09:57:40.191988 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:57:40.191957    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83ecf2bf_00d5_4fff_84fc_e9433710e304.slice/crio-59a3ed50562043e8a6345b96a46a72470e87be2614e486e6ba430845a5529bca WatchSource:0}: Error finding container 59a3ed50562043e8a6345b96a46a72470e87be2614e486e6ba430845a5529bca: Status 404 returned error can't find the container with id 59a3ed50562043e8a6345b96a46a72470e87be2614e486e6ba430845a5529bca
Sep 14 09:57:40.657113 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:40.657078    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d" event={"ID":"2c14846d-0cce-4a56-ba26-1c75b32172cc","Type":"ContainerStarted","Data":"9d70bc186a62c166bcaeb66b3cd71f5ae417d67de7da164e7365195524842e28"}
Sep 14 09:57:40.657277 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:40.657132    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn" event={"ID":"83ecf2bf-00d5-4fff-84fc-e9433710e304","Type":"ContainerStarted","Data":"291ca471ee2a9a97d43089384c964e8a4cf4ba42c289cb74313a5b43b6600791"}
Sep 14 09:57:40.657277 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:40.657154    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"
Sep 14 09:57:40.657277 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:40.657169    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn" event={"ID":"83ecf2bf-00d5-4fff-84fc-e9433710e304","Type":"ContainerStarted","Data":"59a3ed50562043e8a6345b96a46a72470e87be2614e486e6ba430845a5529bca"}
Sep 14 09:57:40.657277 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:40.657185    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"
Sep 14 09:57:40.657277 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:40.657199    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx"
Sep 14 09:57:40.657277 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:40.657241    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx" event={"ID":"6a0e0f04-6847-4730-afcb-d04c7a21207e","Type":"ContainerStarted","Data":"6f16380c667c7169bd98cfebd5e97bfac4bcb4908d9a11c12926058714cc2427"}
Sep 14 09:57:40.657277 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:40.657270    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx" event={"ID":"6a0e0f04-6847-4730-afcb-d04c7a21207e","Type":"ContainerStarted","Data":"83f38688ca2730d11f39ee65d677f57cf87519f35d138d24b7d84881d8c0ecc9"}
Sep 14 09:57:40.679778 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:40.679699    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d" podStartSLOduration=2.285191397 podStartE2EDuration="2.679682834s" totalImagesPullingTime="394.491437ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:57:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:57:40.679134202 +0000 UTC m=+876.537366626" watchObservedRunningTime="2026-09-14 09:57:40.679682834 +0000 UTC m=+876.537915190"
Sep 14 09:57:40.718090 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:40.718012    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx" podStartSLOduration=1.7179887360000001 podStartE2EDuration="1.717988736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:57:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:57:40.716330357 +0000 UTC m=+876.574562712" watchObservedRunningTime="2026-09-14 09:57:40.717988736 +0000 UTC m=+876.576221096"
Sep 14 09:57:40.744675 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:40.744611    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn" podStartSLOduration=1.418977431 podStartE2EDuration="1.744591391s" totalImagesPullingTime="325.61396ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:57:40.742869078 +0000 UTC m=+876.601101434" watchObservedRunningTime="2026-09-14 09:57:40.744591391 +0000 UTC m=+876.602823747"
Sep 14 09:57:46.669982 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:46.669950    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"
Sep 14 09:57:46.670464 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:46.670036    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"
Sep 14 09:57:51.666104 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:51.666072    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx"
Sep 14 09:57:53.297681 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:53.297638    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 09:57:54.905653 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:54.905611    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr"]
Sep 14 09:57:54.911042 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:54.911015    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr"
Sep 14 09:57:54.914501 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:54.914469    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-24873d-dockercfg-lrtx2\""
Sep 14 09:57:54.914661 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:54.914511    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-24873d\""
Sep 14 09:57:54.923560 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:54.923531    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr"]
Sep 14 09:57:54.986923 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:54.986893    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34e9540a-d439-448d-a87e-356ea78e682d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr\" (UID: \"34e9540a-d439-448d-a87e-356ea78e682d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr"
Sep 14 09:57:54.987075 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:54.986967    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb6sh\" (UniqueName: \"kubernetes.io/projected/34e9540a-d439-448d-a87e-356ea78e682d-kube-api-access-pb6sh\") pod \"payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr\" (UID: \"34e9540a-d439-448d-a87e-356ea78e682d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr"
Sep 14 09:57:55.087874 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:55.087832    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb6sh\" (UniqueName: \"kubernetes.io/projected/34e9540a-d439-448d-a87e-356ea78e682d-kube-api-access-pb6sh\") pod \"payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr\" (UID: \"34e9540a-d439-448d-a87e-356ea78e682d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr"
Sep 14 09:57:55.088061 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:55.087942    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34e9540a-d439-448d-a87e-356ea78e682d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr\" (UID: \"34e9540a-d439-448d-a87e-356ea78e682d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr"
Sep 14 09:57:55.088618 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:55.088598    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34e9540a-d439-448d-a87e-356ea78e682d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr\" (UID: \"34e9540a-d439-448d-a87e-356ea78e682d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr"
Sep 14 09:57:55.098034 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:55.098004    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb6sh\" (UniqueName: \"kubernetes.io/projected/34e9540a-d439-448d-a87e-356ea78e682d-kube-api-access-pb6sh\") pod \"payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr\" (UID: \"34e9540a-d439-448d-a87e-356ea78e682d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr"
Sep 14 09:57:55.254063 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:55.254023    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr"
Sep 14 09:57:55.540697 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:55.540670    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr"]
Sep 14 09:57:55.543109 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:57:55.543080    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34e9540a_d439_448d_a87e_356ea78e682d.slice/crio-05e81c51381ca9f2f325ca99992320e1c842cec13af4a7027832185d2dbcc986 WatchSource:0}: Error finding container 05e81c51381ca9f2f325ca99992320e1c842cec13af4a7027832185d2dbcc986: Status 404 returned error can't find the container with id 05e81c51381ca9f2f325ca99992320e1c842cec13af4a7027832185d2dbcc986
Sep 14 09:57:55.747819 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:55.747787    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr" event={"ID":"34e9540a-d439-448d-a87e-356ea78e682d","Type":"ContainerStarted","Data":"a934db4a6cdd56b6bd447a00384ebd15798dc4e4268cd19d19528b25fd8bb3dc"}
Sep 14 09:57:55.747984 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:55.747839    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr" event={"ID":"34e9540a-d439-448d-a87e-356ea78e682d","Type":"ContainerStarted","Data":"05e81c51381ca9f2f325ca99992320e1c842cec13af4a7027832185d2dbcc986"}
Sep 14 09:57:55.747984 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:55.747886    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr"
Sep 14 09:57:55.777110 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:57:55.776981    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr" podStartSLOduration=1.776962389 podStartE2EDuration="1.776962389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:57:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:57:55.776340033 +0000 UTC m=+891.634572431" watchObservedRunningTime="2026-09-14 09:57:55.776962389 +0000 UTC m=+891.635194746"
Sep 14 09:58:01.255043 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.254872    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"]
Sep 14 09:58:01.255463 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.255112    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn" podUID="83ecf2bf-00d5-4fff-84fc-e9433710e304" containerName="maas-api" containerID="cri-o://291ca471ee2a9a97d43089384c964e8a4cf4ba42c289cb74313a5b43b6600791" gracePeriod=30
Sep 14 09:58:01.511100 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.511032    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"
Sep 14 09:58:01.557723 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.557680    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fvsf\" (UniqueName: \"kubernetes.io/projected/83ecf2bf-00d5-4fff-84fc-e9433710e304-kube-api-access-7fvsf\") pod \"83ecf2bf-00d5-4fff-84fc-e9433710e304\" (UID: \"83ecf2bf-00d5-4fff-84fc-e9433710e304\") "
Sep 14 09:58:01.557888 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.557744    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83ecf2bf-00d5-4fff-84fc-e9433710e304-openshift-service-ca\") pod \"83ecf2bf-00d5-4fff-84fc-e9433710e304\" (UID: \"83ecf2bf-00d5-4fff-84fc-e9433710e304\") "
Sep 14 09:58:01.557888 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.557779    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83ecf2bf-00d5-4fff-84fc-e9433710e304-maas-api-tls\") pod \"83ecf2bf-00d5-4fff-84fc-e9433710e304\" (UID: \"83ecf2bf-00d5-4fff-84fc-e9433710e304\") "
Sep 14 09:58:01.557975 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.557890    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83ecf2bf-00d5-4fff-84fc-e9433710e304-metrics-certs\") pod \"83ecf2bf-00d5-4fff-84fc-e9433710e304\" (UID: \"83ecf2bf-00d5-4fff-84fc-e9433710e304\") "
Sep 14 09:58:01.558191 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.558163    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83ecf2bf-00d5-4fff-84fc-e9433710e304-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "83ecf2bf-00d5-4fff-84fc-e9433710e304" (UID: "83ecf2bf-00d5-4fff-84fc-e9433710e304"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 09:58:01.558343 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.558318    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83ecf2bf-00d5-4fff-84fc-e9433710e304-openshift-service-ca\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:58:01.560346 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.560310    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83ecf2bf-00d5-4fff-84fc-e9433710e304-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "83ecf2bf-00d5-4fff-84fc-e9433710e304" (UID: "83ecf2bf-00d5-4fff-84fc-e9433710e304"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 09:58:01.560459 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.560360    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83ecf2bf-00d5-4fff-84fc-e9433710e304-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "83ecf2bf-00d5-4fff-84fc-e9433710e304" (UID: "83ecf2bf-00d5-4fff-84fc-e9433710e304"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 09:58:01.560519 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.560464    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83ecf2bf-00d5-4fff-84fc-e9433710e304-kube-api-access-7fvsf" (OuterVolumeSpecName: "kube-api-access-7fvsf") pod "83ecf2bf-00d5-4fff-84fc-e9433710e304" (UID: "83ecf2bf-00d5-4fff-84fc-e9433710e304"). InnerVolumeSpecName "kube-api-access-7fvsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 09:58:01.659453 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.659417    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fvsf\" (UniqueName: \"kubernetes.io/projected/83ecf2bf-00d5-4fff-84fc-e9433710e304-kube-api-access-7fvsf\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:58:01.659453 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.659450    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83ecf2bf-00d5-4fff-84fc-e9433710e304-maas-api-tls\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:58:01.659453 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.659459    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83ecf2bf-00d5-4fff-84fc-e9433710e304-metrics-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:58:01.779396 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.779308    2581 generic.go:356] "Generic (PLEG): container finished" podID="83ecf2bf-00d5-4fff-84fc-e9433710e304" containerID="291ca471ee2a9a97d43089384c964e8a4cf4ba42c289cb74313a5b43b6600791" exitCode=0
Sep 14 09:58:01.779396 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.779345    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn" event={"ID":"83ecf2bf-00d5-4fff-84fc-e9433710e304","Type":"ContainerDied","Data":"291ca471ee2a9a97d43089384c964e8a4cf4ba42c289cb74313a5b43b6600791"}
Sep 14 09:58:01.779396 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.779354    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"
Sep 14 09:58:01.779396 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.779383    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn" event={"ID":"83ecf2bf-00d5-4fff-84fc-e9433710e304","Type":"ContainerDied","Data":"59a3ed50562043e8a6345b96a46a72470e87be2614e486e6ba430845a5529bca"}
Sep 14 09:58:01.779646 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.779404    2581 scope.go:117] "RemoveContainer" containerID="291ca471ee2a9a97d43089384c964e8a4cf4ba42c289cb74313a5b43b6600791"
Sep 14 09:58:01.789012 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.788993    2581 scope.go:117] "RemoveContainer" containerID="291ca471ee2a9a97d43089384c964e8a4cf4ba42c289cb74313a5b43b6600791"
Sep 14 09:58:01.789274 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:58:01.789255    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"291ca471ee2a9a97d43089384c964e8a4cf4ba42c289cb74313a5b43b6600791\": container with ID starting with 291ca471ee2a9a97d43089384c964e8a4cf4ba42c289cb74313a5b43b6600791 not found: ID does not exist" containerID="291ca471ee2a9a97d43089384c964e8a4cf4ba42c289cb74313a5b43b6600791"
Sep 14 09:58:01.789322 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.789284    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"291ca471ee2a9a97d43089384c964e8a4cf4ba42c289cb74313a5b43b6600791"} err="failed to get container status \"291ca471ee2a9a97d43089384c964e8a4cf4ba42c289cb74313a5b43b6600791\": rpc error: code = NotFound desc = could not find container \"291ca471ee2a9a97d43089384c964e8a4cf4ba42c289cb74313a5b43b6600791\": container with ID starting with 291ca471ee2a9a97d43089384c964e8a4cf4ba42c289cb74313a5b43b6600791 not found: ID does not exist"
Sep 14 09:58:01.807563 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.807520    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"]
Sep 14 09:58:01.811884 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:01.811858    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9eed367b-7cf8d8576f-k2jzn"]
Sep 14 09:58:02.656821 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:02.656792    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83ecf2bf-00d5-4fff-84fc-e9433710e304" path="/var/lib/kubelet/pods/83ecf2bf-00d5-4fff-84fc-e9433710e304/volumes"
Sep 14 09:58:06.488310 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:06.488261    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 09:58:06.755513 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:06.755431    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr"
Sep 14 09:58:07.477187 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:07.477138    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"]
Sep 14 09:58:07.478060 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:07.478034    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83ecf2bf-00d5-4fff-84fc-e9433710e304" containerName="maas-api"
Sep 14 09:58:07.478060 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:07.478057    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="83ecf2bf-00d5-4fff-84fc-e9433710e304" containerName="maas-api"
Sep 14 09:58:07.478331 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:07.478305    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="83ecf2bf-00d5-4fff-84fc-e9433710e304" containerName="maas-api"
Sep 14 09:58:07.483967 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:07.483936    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"
Sep 14 09:58:07.487403 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:07.487379    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"]
Sep 14 09:58:07.487638 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:07.487613    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-2f4712d0-serving-cert\""
Sep 14 09:58:07.614054 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:07.614017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/358033b7-49c4-475c-b1b1-ad0c157f86ce-metrics-certs\") pod \"maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz\" (UID: \"358033b7-49c4-475c-b1b1-ad0c157f86ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"
Sep 14 09:58:07.614054 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:07.614055    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/358033b7-49c4-475c-b1b1-ad0c157f86ce-maas-api-tls\") pod \"maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz\" (UID: \"358033b7-49c4-475c-b1b1-ad0c157f86ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"
Sep 14 09:58:07.614471 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:07.614162    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/358033b7-49c4-475c-b1b1-ad0c157f86ce-openshift-service-ca\") pod \"maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz\" (UID: \"358033b7-49c4-475c-b1b1-ad0c157f86ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"
Sep 14 09:58:07.614471 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:07.614207    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25gf8\" (UniqueName: \"kubernetes.io/projected/358033b7-49c4-475c-b1b1-ad0c157f86ce-kube-api-access-25gf8\") pod \"maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz\" (UID: \"358033b7-49c4-475c-b1b1-ad0c157f86ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"
Sep 14 09:58:07.715399 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:07.715357    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/358033b7-49c4-475c-b1b1-ad0c157f86ce-openshift-service-ca\") pod \"maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz\" (UID: \"358033b7-49c4-475c-b1b1-ad0c157f86ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"
Sep 14 09:58:07.715609 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:07.715498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25gf8\" (UniqueName: \"kubernetes.io/projected/358033b7-49c4-475c-b1b1-ad0c157f86ce-kube-api-access-25gf8\") pod \"maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz\" (UID: \"358033b7-49c4-475c-b1b1-ad0c157f86ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"
Sep 14 09:58:07.715680 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:07.715646    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/358033b7-49c4-475c-b1b1-ad0c157f86ce-metrics-certs\") pod \"maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz\" (UID: \"358033b7-49c4-475c-b1b1-ad0c157f86ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"
Sep 14 09:58:07.715770 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:07.715682    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/358033b7-49c4-475c-b1b1-ad0c157f86ce-maas-api-tls\") pod \"maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz\" (UID: \"358033b7-49c4-475c-b1b1-ad0c157f86ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"
Sep 14 09:58:07.716475 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:07.716427    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/358033b7-49c4-475c-b1b1-ad0c157f86ce-openshift-service-ca\") pod \"maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz\" (UID: \"358033b7-49c4-475c-b1b1-ad0c157f86ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"
Sep 14 09:58:07.718111 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:07.718093    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/358033b7-49c4-475c-b1b1-ad0c157f86ce-maas-api-tls\") pod \"maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz\" (UID: \"358033b7-49c4-475c-b1b1-ad0c157f86ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"
Sep 14 09:58:07.718242 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:07.718224    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/358033b7-49c4-475c-b1b1-ad0c157f86ce-metrics-certs\") pod \"maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz\" (UID: \"358033b7-49c4-475c-b1b1-ad0c157f86ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"
Sep 14 09:58:07.724150 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:07.724125    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25gf8\" (UniqueName: \"kubernetes.io/projected/358033b7-49c4-475c-b1b1-ad0c157f86ce-kube-api-access-25gf8\") pod \"maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz\" (UID: \"358033b7-49c4-475c-b1b1-ad0c157f86ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"
Sep 14 09:58:07.796519 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:07.796426    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"
Sep 14 09:58:08.093843 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:08.093812    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"]
Sep 14 09:58:08.095549 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:58:08.095524    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod358033b7_49c4_475c_b1b1_ad0c157f86ce.slice/crio-a3d5b2cee43fbd8269e3c5081a15ecb91af2f48f44ad7642cee65a1dc07a48c0 WatchSource:0}: Error finding container a3d5b2cee43fbd8269e3c5081a15ecb91af2f48f44ad7642cee65a1dc07a48c0: Status 404 returned error can't find the container with id a3d5b2cee43fbd8269e3c5081a15ecb91af2f48f44ad7642cee65a1dc07a48c0
Sep 14 09:58:08.820649 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:08.820605    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz" event={"ID":"358033b7-49c4-475c-b1b1-ad0c157f86ce","Type":"ContainerStarted","Data":"8f2b1e4add9abd2a9b55b3adc78ca0be44e1d780e2befffd7ef24891b844c50f"}
Sep 14 09:58:08.821063 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:08.820774    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"
Sep 14 09:58:08.821063 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:08.820804    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz" event={"ID":"358033b7-49c4-475c-b1b1-ad0c157f86ce","Type":"ContainerStarted","Data":"a3d5b2cee43fbd8269e3c5081a15ecb91af2f48f44ad7642cee65a1dc07a48c0"}
Sep 14 09:58:08.840253 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:08.840188    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz" podStartSLOduration=1.2370289030000001 podStartE2EDuration="1.840170194s" totalImagesPullingTime="603.141291ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:58:08.839386312 +0000 UTC m=+904.697618669" watchObservedRunningTime="2026-09-14 09:58:08.840170194 +0000 UTC m=+904.698402608"
Sep 14 09:58:14.834521 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:14.834492    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"
Sep 14 09:58:19.996055 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:19.996017    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 09:58:37.051096 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.051055    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"]
Sep 14 09:58:37.051613 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.051309    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz" podUID="358033b7-49c4-475c-b1b1-ad0c157f86ce" containerName="maas-api" containerID="cri-o://8f2b1e4add9abd2a9b55b3adc78ca0be44e1d780e2befffd7ef24891b844c50f" gracePeriod=30
Sep 14 09:58:37.322170 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.322132    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"
Sep 14 09:58:37.408046 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.408009    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/358033b7-49c4-475c-b1b1-ad0c157f86ce-openshift-service-ca\") pod \"358033b7-49c4-475c-b1b1-ad0c157f86ce\" (UID: \"358033b7-49c4-475c-b1b1-ad0c157f86ce\") "
Sep 14 09:58:37.408248 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.408057    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/358033b7-49c4-475c-b1b1-ad0c157f86ce-metrics-certs\") pod \"358033b7-49c4-475c-b1b1-ad0c157f86ce\" (UID: \"358033b7-49c4-475c-b1b1-ad0c157f86ce\") "
Sep 14 09:58:37.408248 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.408218    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/358033b7-49c4-475c-b1b1-ad0c157f86ce-maas-api-tls\") pod \"358033b7-49c4-475c-b1b1-ad0c157f86ce\" (UID: \"358033b7-49c4-475c-b1b1-ad0c157f86ce\") "
Sep 14 09:58:37.408248 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.408244    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25gf8\" (UniqueName: \"kubernetes.io/projected/358033b7-49c4-475c-b1b1-ad0c157f86ce-kube-api-access-25gf8\") pod \"358033b7-49c4-475c-b1b1-ad0c157f86ce\" (UID: \"358033b7-49c4-475c-b1b1-ad0c157f86ce\") "
Sep 14 09:58:37.408640 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.408455    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/358033b7-49c4-475c-b1b1-ad0c157f86ce-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "358033b7-49c4-475c-b1b1-ad0c157f86ce" (UID: "358033b7-49c4-475c-b1b1-ad0c157f86ce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 09:58:37.408640 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.408552    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/358033b7-49c4-475c-b1b1-ad0c157f86ce-openshift-service-ca\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:58:37.410383 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.410345    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/358033b7-49c4-475c-b1b1-ad0c157f86ce-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "358033b7-49c4-475c-b1b1-ad0c157f86ce" (UID: "358033b7-49c4-475c-b1b1-ad0c157f86ce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 09:58:37.410526 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.410446    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/358033b7-49c4-475c-b1b1-ad0c157f86ce-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "358033b7-49c4-475c-b1b1-ad0c157f86ce" (UID: "358033b7-49c4-475c-b1b1-ad0c157f86ce"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 09:58:37.410587 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.410541    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/358033b7-49c4-475c-b1b1-ad0c157f86ce-kube-api-access-25gf8" (OuterVolumeSpecName: "kube-api-access-25gf8") pod "358033b7-49c4-475c-b1b1-ad0c157f86ce" (UID: "358033b7-49c4-475c-b1b1-ad0c157f86ce"). InnerVolumeSpecName "kube-api-access-25gf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 09:58:37.509656 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.509606    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/358033b7-49c4-475c-b1b1-ad0c157f86ce-maas-api-tls\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:58:37.509656 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.509646    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25gf8\" (UniqueName: \"kubernetes.io/projected/358033b7-49c4-475c-b1b1-ad0c157f86ce-kube-api-access-25gf8\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:58:37.509656 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.509657    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/358033b7-49c4-475c-b1b1-ad0c157f86ce-metrics-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:58:37.975673 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.975631    2581 generic.go:356] "Generic (PLEG): container finished" podID="358033b7-49c4-475c-b1b1-ad0c157f86ce" containerID="8f2b1e4add9abd2a9b55b3adc78ca0be44e1d780e2befffd7ef24891b844c50f" exitCode=0
Sep 14 09:58:37.975673 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.975675    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"
Sep 14 09:58:37.975904 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.975722    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz" event={"ID":"358033b7-49c4-475c-b1b1-ad0c157f86ce","Type":"ContainerDied","Data":"8f2b1e4add9abd2a9b55b3adc78ca0be44e1d780e2befffd7ef24891b844c50f"}
Sep 14 09:58:37.975904 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.975780    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz" event={"ID":"358033b7-49c4-475c-b1b1-ad0c157f86ce","Type":"ContainerDied","Data":"a3d5b2cee43fbd8269e3c5081a15ecb91af2f48f44ad7642cee65a1dc07a48c0"}
Sep 14 09:58:37.975904 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.975802    2581 scope.go:117] "RemoveContainer" containerID="8f2b1e4add9abd2a9b55b3adc78ca0be44e1d780e2befffd7ef24891b844c50f"
Sep 14 09:58:37.986130 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.986104    2581 scope.go:117] "RemoveContainer" containerID="8f2b1e4add9abd2a9b55b3adc78ca0be44e1d780e2befffd7ef24891b844c50f"
Sep 14 09:58:37.986429 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:58:37.986411    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f2b1e4add9abd2a9b55b3adc78ca0be44e1d780e2befffd7ef24891b844c50f\": container with ID starting with 8f2b1e4add9abd2a9b55b3adc78ca0be44e1d780e2befffd7ef24891b844c50f not found: ID does not exist" containerID="8f2b1e4add9abd2a9b55b3adc78ca0be44e1d780e2befffd7ef24891b844c50f"
Sep 14 09:58:37.986484 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.986437    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f2b1e4add9abd2a9b55b3adc78ca0be44e1d780e2befffd7ef24891b844c50f"} err="failed to get container status \"8f2b1e4add9abd2a9b55b3adc78ca0be44e1d780e2befffd7ef24891b844c50f\": rpc error: code = NotFound desc = could not find container \"8f2b1e4add9abd2a9b55b3adc78ca0be44e1d780e2befffd7ef24891b844c50f\": container with ID starting with 8f2b1e4add9abd2a9b55b3adc78ca0be44e1d780e2befffd7ef24891b844c50f not found: ID does not exist"
Sep 14 09:58:37.999477 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:37.999438    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"]
Sep 14 09:58:38.005742 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:38.005698    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2f4712d0-545db97b6c-b8tzz"]
Sep 14 09:58:38.656799 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:38.656755    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="358033b7-49c4-475c-b1b1-ad0c157f86ce" path="/var/lib/kubelet/pods/358033b7-49c4-475c-b1b1-ad0c157f86ce/volumes"
Sep 14 09:58:42.901482 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:42.901443    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 09:58:44.269005 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:44.268965    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"]
Sep 14 09:58:44.271487 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:44.269394    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="358033b7-49c4-475c-b1b1-ad0c157f86ce" containerName="maas-api"
Sep 14 09:58:44.271487 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:44.269406    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="358033b7-49c4-475c-b1b1-ad0c157f86ce" containerName="maas-api"
Sep 14 09:58:44.271487 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:44.269485    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="358033b7-49c4-475c-b1b1-ad0c157f86ce" containerName="maas-api"
Sep 14 09:58:44.272486 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:44.272468    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"
Sep 14 09:58:44.275647 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:44.275619    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e7fe0e18-serving-cert\""
Sep 14 09:58:44.283663 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:44.283636    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"]
Sep 14 09:58:44.379784 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:44.379752    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-metrics-certs\") pod \"maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp\" (UID: \"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"
Sep 14 09:58:44.380008 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:44.379837    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-maas-api-tls\") pod \"maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp\" (UID: \"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"
Sep 14 09:58:44.380008 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:44.379882    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2vvp\" (UniqueName: \"kubernetes.io/projected/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-kube-api-access-b2vvp\") pod \"maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp\" (UID: \"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"
Sep 14 09:58:44.380008 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:44.379939    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-openshift-service-ca\") pod \"maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp\" (UID: \"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"
Sep 14 09:58:44.480441 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:44.480402    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-openshift-service-ca\") pod \"maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp\" (UID: \"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"
Sep 14 09:58:44.480614 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:44.480454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-metrics-certs\") pod \"maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp\" (UID: \"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"
Sep 14 09:58:44.480614 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:44.480499    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-maas-api-tls\") pod \"maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp\" (UID: \"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"
Sep 14 09:58:44.480614 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:44.480533    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2vvp\" (UniqueName: \"kubernetes.io/projected/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-kube-api-access-b2vvp\") pod \"maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp\" (UID: \"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"
Sep 14 09:58:44.480800 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:58:44.480637    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-serving-cert: secret "maas-api-e2e-ait-e7fe0e18-serving-cert" not found
Sep 14 09:58:44.480800 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:58:44.480737    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-maas-api-tls podName:5a85ac70-3186-4b4d-85c0-e7d6dbe38d92 nodeName:}" failed. No retries permitted until 2026-09-14 09:58:44.980702712 +0000 UTC m=+940.838935063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-maas-api-tls") pod "maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp" (UID: "5a85ac70-3186-4b4d-85c0-e7d6dbe38d92") : secret "maas-api-e2e-ait-e7fe0e18-serving-cert" not found
Sep 14 09:58:44.481095 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:44.481070    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-openshift-service-ca\") pod \"maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp\" (UID: \"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"
Sep 14 09:58:44.483099 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:44.483077    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-metrics-certs\") pod \"maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp\" (UID: \"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"
Sep 14 09:58:44.490223 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:44.490195    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2vvp\" (UniqueName: \"kubernetes.io/projected/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-kube-api-access-b2vvp\") pod \"maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp\" (UID: \"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"
Sep 14 09:58:44.985580 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:44.985536    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-maas-api-tls\") pod \"maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp\" (UID: \"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"
Sep 14 09:58:44.988019 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:44.987995    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-maas-api-tls\") pod \"maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp\" (UID: \"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"
Sep 14 09:58:45.184868 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:45.184827    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"
Sep 14 09:58:45.253397 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:45.253359    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg"]
Sep 14 09:58:45.258088 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:45.258062    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg"
Sep 14 09:58:45.261232 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:45.261202    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-e7fe0e18\""
Sep 14 09:58:45.261232 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:45.261205    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-e7fe0e18-dockercfg-jx9v4\""
Sep 14 09:58:45.276013 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:45.275977    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg"]
Sep 14 09:58:45.389142 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:45.389103    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e-plugins-config-volume\") pod \"payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg\" (UID: \"f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e\") " pod="openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg"
Sep 14 09:58:45.389334 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:45.389176    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vbjk\" (UniqueName: \"kubernetes.io/projected/f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e-kube-api-access-8vbjk\") pod \"payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg\" (UID: \"f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e\") " pod="openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg"
Sep 14 09:58:45.470928 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:45.470894    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"]
Sep 14 09:58:45.474894 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:58:45.474860    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a85ac70_3186_4b4d_85c0_e7d6dbe38d92.slice/crio-b4bb106c9216123e5411b1ed558630b708c728a528e18e26ba9e70a470806e65 WatchSource:0}: Error finding container b4bb106c9216123e5411b1ed558630b708c728a528e18e26ba9e70a470806e65: Status 404 returned error can't find the container with id b4bb106c9216123e5411b1ed558630b708c728a528e18e26ba9e70a470806e65
Sep 14 09:58:45.490007 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:45.489918    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e-plugins-config-volume\") pod \"payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg\" (UID: \"f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e\") " pod="openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg"
Sep 14 09:58:45.490007 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:45.489995    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vbjk\" (UniqueName: \"kubernetes.io/projected/f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e-kube-api-access-8vbjk\") pod \"payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg\" (UID: \"f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e\") " pod="openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg"
Sep 14 09:58:45.490872 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:45.490838    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e-plugins-config-volume\") pod \"payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg\" (UID: \"f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e\") " pod="openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg"
Sep 14 09:58:45.500533 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:45.500503    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vbjk\" (UniqueName: \"kubernetes.io/projected/f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e-kube-api-access-8vbjk\") pod \"payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg\" (UID: \"f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e\") " pod="openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg"
Sep 14 09:58:45.572726 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:45.572675    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg"
Sep 14 09:58:45.852308 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:45.852230    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg"]
Sep 14 09:58:45.856474 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:58:45.856441    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2a01876_8b26_4be7_9fc5_0a5aa08ebd4e.slice/crio-2afd74b410f91558b67549ae8bdb13a44159dea8015bddca7f621d692b5dd4fc WatchSource:0}: Error finding container 2afd74b410f91558b67549ae8bdb13a44159dea8015bddca7f621d692b5dd4fc: Status 404 returned error can't find the container with id 2afd74b410f91558b67549ae8bdb13a44159dea8015bddca7f621d692b5dd4fc
Sep 14 09:58:46.022253 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:46.022220    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg" event={"ID":"f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e","Type":"ContainerStarted","Data":"40d563198c41d2610c76e75c7c017c2e43eadb83ef34bed0f86ff126c5bf0574"}
Sep 14 09:58:46.022434 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:46.022271    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg" event={"ID":"f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e","Type":"ContainerStarted","Data":"2afd74b410f91558b67549ae8bdb13a44159dea8015bddca7f621d692b5dd4fc"}
Sep 14 09:58:46.022507 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:46.022433    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg"
Sep 14 09:58:46.024205 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:46.024179    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp" event={"ID":"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92","Type":"ContainerStarted","Data":"1d7673f6ec79aceac0aac7dbb53860dbd7843238b5eac6752e31dfe2f40bbfcf"}
Sep 14 09:58:46.024332 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:46.024219    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp" event={"ID":"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92","Type":"ContainerStarted","Data":"b4bb106c9216123e5411b1ed558630b708c728a528e18e26ba9e70a470806e65"}
Sep 14 09:58:46.024332 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:46.024240    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"
Sep 14 09:58:46.050465 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:46.050408    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg" podStartSLOduration=1.050389641 podStartE2EDuration="1.050389641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:58:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:58:46.047533587 +0000 UTC m=+941.905765963" watchObservedRunningTime="2026-09-14 09:58:46.050389641 +0000 UTC m=+941.908622046"
Sep 14 09:58:52.035547 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:52.035517    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"
Sep 14 09:58:52.056523 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:52.056449    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp" podStartSLOduration=7.598139313 podStartE2EDuration="8.056426304s" totalImagesPullingTime="458.286991ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:58:46.07675549 +0000 UTC m=+941.934987840" watchObservedRunningTime="2026-09-14 09:58:52.056426304 +0000 UTC m=+947.914658662"
Sep 14 09:58:56.375778 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:56.375736    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 09:58:57.032415 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:58:57.032374    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg"
Sep 14 09:59:18.185289 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:18.185245    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 09:59:23.283238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.283203    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"]
Sep 14 09:59:23.283664 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.283433    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp" podUID="5a85ac70-3186-4b4d-85c0-e7d6dbe38d92" containerName="maas-api" containerID="cri-o://1d7673f6ec79aceac0aac7dbb53860dbd7843238b5eac6752e31dfe2f40bbfcf" gracePeriod=30
Sep 14 09:59:23.371367 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.371331    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg"]
Sep 14 09:59:23.371565 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.371539    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg" podUID="f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e" containerName="payload-processing" containerID="cri-o://40d563198c41d2610c76e75c7c017c2e43eadb83ef34bed0f86ff126c5bf0574" gracePeriod=30
Sep 14 09:59:23.636926 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.636885    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"
Sep 14 09:59:23.671682 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.671653    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg"
Sep 14 09:59:23.762518 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.762478    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vbjk\" (UniqueName: \"kubernetes.io/projected/f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e-kube-api-access-8vbjk\") pod \"f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e\" (UID: \"f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e\") "
Sep 14 09:59:23.762740 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.762551    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2vvp\" (UniqueName: \"kubernetes.io/projected/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-kube-api-access-b2vvp\") pod \"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92\" (UID: \"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92\") "
Sep 14 09:59:23.762740 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.762580    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-maas-api-tls\") pod \"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92\" (UID: \"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92\") "
Sep 14 09:59:23.762740 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.762631    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e-plugins-config-volume\") pod \"f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e\" (UID: \"f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e\") "
Sep 14 09:59:23.762740 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.762650    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-metrics-certs\") pod \"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92\" (UID: \"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92\") "
Sep 14 09:59:23.762740 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.762665    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-openshift-service-ca\") pod \"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92\" (UID: \"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92\") "
Sep 14 09:59:23.763087 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.763054    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5a85ac70-3186-4b4d-85c0-e7d6dbe38d92" (UID: "5a85ac70-3186-4b4d-85c0-e7d6dbe38d92"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 09:59:23.763152 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.763082    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e" (UID: "f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 09:59:23.764952 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.764912    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e-kube-api-access-8vbjk" (OuterVolumeSpecName: "kube-api-access-8vbjk") pod "f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e" (UID: "f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e"). InnerVolumeSpecName "kube-api-access-8vbjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 09:59:23.765067 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.764957    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5a85ac70-3186-4b4d-85c0-e7d6dbe38d92" (UID: "5a85ac70-3186-4b4d-85c0-e7d6dbe38d92"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 09:59:23.765214 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.765194    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5a85ac70-3186-4b4d-85c0-e7d6dbe38d92" (UID: "5a85ac70-3186-4b4d-85c0-e7d6dbe38d92"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 09:59:23.765281 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.765226    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-kube-api-access-b2vvp" (OuterVolumeSpecName: "kube-api-access-b2vvp") pod "5a85ac70-3186-4b4d-85c0-e7d6dbe38d92" (UID: "5a85ac70-3186-4b4d-85c0-e7d6dbe38d92"). InnerVolumeSpecName "kube-api-access-b2vvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 09:59:23.864309 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.864225    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vbjk\" (UniqueName: \"kubernetes.io/projected/f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e-kube-api-access-8vbjk\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:59:23.864309 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.864255    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2vvp\" (UniqueName: \"kubernetes.io/projected/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-kube-api-access-b2vvp\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:59:23.864309 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.864275    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-maas-api-tls\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:59:23.864309 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.864285    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e-plugins-config-volume\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:59:23.864309 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.864294    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-metrics-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:59:23.864309 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:23.864302    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92-openshift-service-ca\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 09:59:24.234972 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:24.234929    2581 generic.go:356] "Generic (PLEG): container finished" podID="f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e" containerID="40d563198c41d2610c76e75c7c017c2e43eadb83ef34bed0f86ff126c5bf0574" exitCode=0
Sep 14 09:59:24.234972 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:24.234974    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg"
Sep 14 09:59:24.235250 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:24.235016    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg" event={"ID":"f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e","Type":"ContainerDied","Data":"40d563198c41d2610c76e75c7c017c2e43eadb83ef34bed0f86ff126c5bf0574"}
Sep 14 09:59:24.235250 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:24.235081    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg" event={"ID":"f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e","Type":"ContainerDied","Data":"2afd74b410f91558b67549ae8bdb13a44159dea8015bddca7f621d692b5dd4fc"}
Sep 14 09:59:24.235250 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:24.235112    2581 scope.go:117] "RemoveContainer" containerID="40d563198c41d2610c76e75c7c017c2e43eadb83ef34bed0f86ff126c5bf0574"
Sep 14 09:59:24.236411 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:24.236386    2581 generic.go:356] "Generic (PLEG): container finished" podID="5a85ac70-3186-4b4d-85c0-e7d6dbe38d92" containerID="1d7673f6ec79aceac0aac7dbb53860dbd7843238b5eac6752e31dfe2f40bbfcf" exitCode=0
Sep 14 09:59:24.236519 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:24.236414    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp" event={"ID":"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92","Type":"ContainerDied","Data":"1d7673f6ec79aceac0aac7dbb53860dbd7843238b5eac6752e31dfe2f40bbfcf"}
Sep 14 09:59:24.236519 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:24.236492    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp" event={"ID":"5a85ac70-3186-4b4d-85c0-e7d6dbe38d92","Type":"ContainerDied","Data":"b4bb106c9216123e5411b1ed558630b708c728a528e18e26ba9e70a470806e65"}
Sep 14 09:59:24.236519 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:24.236437    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"
Sep 14 09:59:24.246334 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:24.246307    2581 scope.go:117] "RemoveContainer" containerID="40d563198c41d2610c76e75c7c017c2e43eadb83ef34bed0f86ff126c5bf0574"
Sep 14 09:59:24.246798 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:59:24.246776    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40d563198c41d2610c76e75c7c017c2e43eadb83ef34bed0f86ff126c5bf0574\": container with ID starting with 40d563198c41d2610c76e75c7c017c2e43eadb83ef34bed0f86ff126c5bf0574 not found: ID does not exist" containerID="40d563198c41d2610c76e75c7c017c2e43eadb83ef34bed0f86ff126c5bf0574"
Sep 14 09:59:24.246897 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:24.246811    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40d563198c41d2610c76e75c7c017c2e43eadb83ef34bed0f86ff126c5bf0574"} err="failed to get container status \"40d563198c41d2610c76e75c7c017c2e43eadb83ef34bed0f86ff126c5bf0574\": rpc error: code = NotFound desc = could not find container \"40d563198c41d2610c76e75c7c017c2e43eadb83ef34bed0f86ff126c5bf0574\": container with ID starting with 40d563198c41d2610c76e75c7c017c2e43eadb83ef34bed0f86ff126c5bf0574 not found: ID does not exist"
Sep 14 09:59:24.246897 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:24.246837    2581 scope.go:117] "RemoveContainer" containerID="1d7673f6ec79aceac0aac7dbb53860dbd7843238b5eac6752e31dfe2f40bbfcf"
Sep 14 09:59:24.255456 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:24.255430    2581 scope.go:117] "RemoveContainer" containerID="1d7673f6ec79aceac0aac7dbb53860dbd7843238b5eac6752e31dfe2f40bbfcf"
Sep 14 09:59:24.255843 ip-10-0-132-247 kubenswrapper[2581]: E0914 09:59:24.255821    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d7673f6ec79aceac0aac7dbb53860dbd7843238b5eac6752e31dfe2f40bbfcf\": container with ID starting with 1d7673f6ec79aceac0aac7dbb53860dbd7843238b5eac6752e31dfe2f40bbfcf not found: ID does not exist" containerID="1d7673f6ec79aceac0aac7dbb53860dbd7843238b5eac6752e31dfe2f40bbfcf"
Sep 14 09:59:24.255911 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:24.255850    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d7673f6ec79aceac0aac7dbb53860dbd7843238b5eac6752e31dfe2f40bbfcf"} err="failed to get container status \"1d7673f6ec79aceac0aac7dbb53860dbd7843238b5eac6752e31dfe2f40bbfcf\": rpc error: code = NotFound desc = could not find container \"1d7673f6ec79aceac0aac7dbb53860dbd7843238b5eac6752e31dfe2f40bbfcf\": container with ID starting with 1d7673f6ec79aceac0aac7dbb53860dbd7843238b5eac6752e31dfe2f40bbfcf not found: ID does not exist"
Sep 14 09:59:24.259579 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:24.259551    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg"]
Sep 14 09:59:24.267129 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:24.267085    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e7fe0e18-79589cd849-4d7tg"]
Sep 14 09:59:24.276739 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:24.276679    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"]
Sep 14 09:59:24.283870 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:24.283840    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e7fe0e18-6c94cb77-jbwwp"]
Sep 14 09:59:24.657038 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:24.656949    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a85ac70-3186-4b4d-85c0-e7d6dbe38d92" path="/var/lib/kubelet/pods/5a85ac70-3186-4b4d-85c0-e7d6dbe38d92/volumes"
Sep 14 09:59:24.657401 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:24.657386    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e" path="/var/lib/kubelet/pods/f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e/volumes"
Sep 14 09:59:27.416599 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.416518    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"]
Sep 14 09:59:27.416992 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.416970    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e" containerName="payload-processing"
Sep 14 09:59:27.416992 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.416983    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e" containerName="payload-processing"
Sep 14 09:59:27.417068 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.417005    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a85ac70-3186-4b4d-85c0-e7d6dbe38d92" containerName="maas-api"
Sep 14 09:59:27.417068 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.417010    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a85ac70-3186-4b4d-85c0-e7d6dbe38d92" containerName="maas-api"
Sep 14 09:59:27.417130 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.417077    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a85ac70-3186-4b4d-85c0-e7d6dbe38d92" containerName="maas-api"
Sep 14 09:59:27.417130 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.417089    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2a01876-8b26-4be7-9fc5-0a5aa08ebd4e" containerName="payload-processing"
Sep 14 09:59:27.421667 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.421647    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:27.425587 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.425564    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-8c98aa\"/\"autores-model-8c98aa-kserve-self-signed-certs\""
Sep 14 09:59:27.427211 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.427188    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-8c98aa\"/\"openshift-service-ca.crt\""
Sep 14 09:59:27.427327 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.427198    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-8c98aa\"/\"kube-root-ca.crt\""
Sep 14 09:59:27.427327 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.427278    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-8c98aa\"/\"default-dockercfg-tw4qh\""
Sep 14 09:59:27.449021 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.448981    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"]
Sep 14 09:59:27.501451 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.501414    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-tmp-dir\") pod \"autores-model-8c98aa-kserve-8cf7d8967-82rbt\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") " pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:27.501611 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.501474    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pvcj\" (UniqueName: \"kubernetes.io/projected/0d4b908b-e5ee-492f-ab3d-688af183c9d2-kube-api-access-8pvcj\") pod \"autores-model-8c98aa-kserve-8cf7d8967-82rbt\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") " pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:27.501611 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.501553    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d4b908b-e5ee-492f-ab3d-688af183c9d2-tls-certs\") pod \"autores-model-8c98aa-kserve-8cf7d8967-82rbt\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") " pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:27.501703 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.501649    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-model-cache\") pod \"autores-model-8c98aa-kserve-8cf7d8967-82rbt\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") " pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:27.501772 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.501704    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-dshm\") pod \"autores-model-8c98aa-kserve-8cf7d8967-82rbt\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") " pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:27.501772 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.501764    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-home\") pod \"autores-model-8c98aa-kserve-8cf7d8967-82rbt\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") " pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:27.602808 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.602769    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-model-cache\") pod \"autores-model-8c98aa-kserve-8cf7d8967-82rbt\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") " pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:27.603009 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.602843    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-dshm\") pod \"autores-model-8c98aa-kserve-8cf7d8967-82rbt\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") " pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:27.603009 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.602873    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-home\") pod \"autores-model-8c98aa-kserve-8cf7d8967-82rbt\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") " pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:27.603009 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.602929    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-tmp-dir\") pod \"autores-model-8c98aa-kserve-8cf7d8967-82rbt\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") " pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:27.603009 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.602981    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pvcj\" (UniqueName: \"kubernetes.io/projected/0d4b908b-e5ee-492f-ab3d-688af183c9d2-kube-api-access-8pvcj\") pod \"autores-model-8c98aa-kserve-8cf7d8967-82rbt\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") " pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:27.603238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.603016    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d4b908b-e5ee-492f-ab3d-688af183c9d2-tls-certs\") pod \"autores-model-8c98aa-kserve-8cf7d8967-82rbt\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") " pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:27.603238 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.603222    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-model-cache\") pod \"autores-model-8c98aa-kserve-8cf7d8967-82rbt\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") " pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:27.603353 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.603239    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-home\") pod \"autores-model-8c98aa-kserve-8cf7d8967-82rbt\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") " pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:27.603611 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.603585    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-tmp-dir\") pod \"autores-model-8c98aa-kserve-8cf7d8967-82rbt\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") " pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:27.605584 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.605548    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-dshm\") pod \"autores-model-8c98aa-kserve-8cf7d8967-82rbt\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") " pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:27.605825 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.605807    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d4b908b-e5ee-492f-ab3d-688af183c9d2-tls-certs\") pod \"autores-model-8c98aa-kserve-8cf7d8967-82rbt\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") " pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:27.621137 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.621104    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pvcj\" (UniqueName: \"kubernetes.io/projected/0d4b908b-e5ee-492f-ab3d-688af183c9d2-kube-api-access-8pvcj\") pod \"autores-model-8c98aa-kserve-8cf7d8967-82rbt\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") " pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:27.731946 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:27.731905    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:28.020319 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:28.020290    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"]
Sep 14 09:59:28.022639 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:59:28.022607    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d4b908b_e5ee_492f_ab3d_688af183c9d2.slice/crio-bcf808d0d54fff9ee3ea1d92d7a59e03d9bf5d2674fbfed0481ad2de3d1a802e WatchSource:0}: Error finding container bcf808d0d54fff9ee3ea1d92d7a59e03d9bf5d2674fbfed0481ad2de3d1a802e: Status 404 returned error can't find the container with id bcf808d0d54fff9ee3ea1d92d7a59e03d9bf5d2674fbfed0481ad2de3d1a802e
Sep 14 09:59:28.263776 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:28.263739    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt" event={"ID":"0d4b908b-e5ee-492f-ab3d-688af183c9d2","Type":"ContainerStarted","Data":"5e77c28cfa2b6cbce93b14c96a91b089054aded45ad79e9587e379aad08c3394"}
Sep 14 09:59:28.263972 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:28.263786    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt" event={"ID":"0d4b908b-e5ee-492f-ab3d-688af183c9d2","Type":"ContainerStarted","Data":"bcf808d0d54fff9ee3ea1d92d7a59e03d9bf5d2674fbfed0481ad2de3d1a802e"}
Sep 14 09:59:28.303176 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:28.303077    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt" podStartSLOduration=1.303058214 podStartE2EDuration="1.303058214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:59:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:59:28.299704608 +0000 UTC m=+984.157936964" watchObservedRunningTime="2026-09-14 09:59:28.303058214 +0000 UTC m=+984.161290613"
Sep 14 09:59:31.677907 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:31.677869    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x"]
Sep 14 09:59:31.681721 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:31.681680    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x"
Sep 14 09:59:31.684581 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:31.684558    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-80fa7537\""
Sep 14 09:59:31.684735 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:31.684629    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-80fa7537-dockercfg-clhbx\""
Sep 14 09:59:31.693279 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:31.693231    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x"]
Sep 14 09:59:31.745860 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:31.745826    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c86f5cee-6eca-43eb-bc2d-292b2f5e5390-plugins-config-volume\") pod \"payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x\" (UID: \"c86f5cee-6eca-43eb-bc2d-292b2f5e5390\") " pod="openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x"
Sep 14 09:59:31.746038 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:31.745955    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbfx9\" (UniqueName: \"kubernetes.io/projected/c86f5cee-6eca-43eb-bc2d-292b2f5e5390-kube-api-access-dbfx9\") pod \"payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x\" (UID: \"c86f5cee-6eca-43eb-bc2d-292b2f5e5390\") " pod="openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x"
Sep 14 09:59:31.847177 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:31.847134    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbfx9\" (UniqueName: \"kubernetes.io/projected/c86f5cee-6eca-43eb-bc2d-292b2f5e5390-kube-api-access-dbfx9\") pod \"payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x\" (UID: \"c86f5cee-6eca-43eb-bc2d-292b2f5e5390\") " pod="openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x"
Sep 14 09:59:31.847343 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:31.847192    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c86f5cee-6eca-43eb-bc2d-292b2f5e5390-plugins-config-volume\") pod \"payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x\" (UID: \"c86f5cee-6eca-43eb-bc2d-292b2f5e5390\") " pod="openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x"
Sep 14 09:59:31.847971 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:31.847951    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c86f5cee-6eca-43eb-bc2d-292b2f5e5390-plugins-config-volume\") pod \"payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x\" (UID: \"c86f5cee-6eca-43eb-bc2d-292b2f5e5390\") " pod="openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x"
Sep 14 09:59:31.860086 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:31.860054    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbfx9\" (UniqueName: \"kubernetes.io/projected/c86f5cee-6eca-43eb-bc2d-292b2f5e5390-kube-api-access-dbfx9\") pod \"payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x\" (UID: \"c86f5cee-6eca-43eb-bc2d-292b2f5e5390\") " pod="openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x"
Sep 14 09:59:31.901194 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:31.901158    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 09:59:31.994482 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:31.994452    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x"
Sep 14 09:59:32.292917 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:32.292881    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x"]
Sep 14 09:59:32.294785 ip-10-0-132-247 kubenswrapper[2581]: W0914 09:59:32.294752    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc86f5cee_6eca_43eb_bc2d_292b2f5e5390.slice/crio-cd5352690646b4cee673e849b468cbfbf42ddd1308b8416f4a1bed3e29c08b0e WatchSource:0}: Error finding container cd5352690646b4cee673e849b468cbfbf42ddd1308b8416f4a1bed3e29c08b0e: Status 404 returned error can't find the container with id cd5352690646b4cee673e849b468cbfbf42ddd1308b8416f4a1bed3e29c08b0e
Sep 14 09:59:33.292451 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:33.292415    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x" event={"ID":"c86f5cee-6eca-43eb-bc2d-292b2f5e5390","Type":"ContainerStarted","Data":"726e24bf8a4be5b1a1a7c2589d6058faec05878637a55eac143efc1e8784fd24"}
Sep 14 09:59:33.292993 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:33.292467    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x" event={"ID":"c86f5cee-6eca-43eb-bc2d-292b2f5e5390","Type":"ContainerStarted","Data":"cd5352690646b4cee673e849b468cbfbf42ddd1308b8416f4a1bed3e29c08b0e"}
Sep 14 09:59:33.292993 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:33.292543    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x"
Sep 14 09:59:33.320483 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:33.320423    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x" podStartSLOduration=2.320401613 podStartE2EDuration="2.320401613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 09:59:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 09:59:33.317962339 +0000 UTC m=+989.176194694" watchObservedRunningTime="2026-09-14 09:59:33.320401613 +0000 UTC m=+989.178633975"
Sep 14 09:59:37.732848 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:37.732814    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:37.733240 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:37.732867    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:37.745793 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:37.745761    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:38.330170 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:38.330140    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 09:59:44.299983 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:44.299949    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x"
Sep 14 09:59:50.286635 ip-10-0-132-247 kubenswrapper[2581]: I0914 09:59:50.286592    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:00:00.224038 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:00.223992    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-80fa7537-29823000-l6fnm"]
Sep 14 10:00:00.227981 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:00.227958    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-80fa7537-29823000-l6fnm"
Sep 14 10:00:00.233123 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:00.233090    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gf4xj\""
Sep 14 10:00:00.237604 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:00.237583    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-80fa7537-29823000-l6fnm"
Sep 14 10:00:00.244519 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:00.244495    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-80fa7537-29823000-l6fnm"]
Sep 14 10:00:00.521558 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:00.521530    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-80fa7537-29823000-l6fnm"]
Sep 14 10:00:00.523871 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:00:00.523838    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8091401_be47_4ec5_983d_47c233654acd.slice/crio-9c3c7583f4a326a24e89ce390eeef03aa1ade417344345d79638c5b166d0726f WatchSource:0}: Error finding container 9c3c7583f4a326a24e89ce390eeef03aa1ade417344345d79638c5b166d0726f: Status 404 returned error can't find the container with id 9c3c7583f4a326a24e89ce390eeef03aa1ade417344345d79638c5b166d0726f
Sep 14 10:00:00.526129 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:00.526111    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 10:00:00.578285 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:00.578250    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-80fa7537-29823000-l6fnm"]
Sep 14 10:00:00.599310 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:00.599272    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x"]
Sep 14 10:00:00.599552 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:00.599525    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x" podUID="c86f5cee-6eca-43eb-bc2d-292b2f5e5390" containerName="payload-processing" containerID="cri-o://726e24bf8a4be5b1a1a7c2589d6058faec05878637a55eac143efc1e8784fd24" gracePeriod=30
Sep 14 10:00:00.861413 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:00.861384    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x"
Sep 14 10:00:00.915012 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:00.914979    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbfx9\" (UniqueName: \"kubernetes.io/projected/c86f5cee-6eca-43eb-bc2d-292b2f5e5390-kube-api-access-dbfx9\") pod \"c86f5cee-6eca-43eb-bc2d-292b2f5e5390\" (UID: \"c86f5cee-6eca-43eb-bc2d-292b2f5e5390\") "
Sep 14 10:00:00.915213 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:00.915074    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c86f5cee-6eca-43eb-bc2d-292b2f5e5390-plugins-config-volume\") pod \"c86f5cee-6eca-43eb-bc2d-292b2f5e5390\" (UID: \"c86f5cee-6eca-43eb-bc2d-292b2f5e5390\") "
Sep 14 10:00:00.915544 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:00.915507    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c86f5cee-6eca-43eb-bc2d-292b2f5e5390-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c86f5cee-6eca-43eb-bc2d-292b2f5e5390" (UID: "c86f5cee-6eca-43eb-bc2d-292b2f5e5390"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:00:00.917102 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:00.917075    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c86f5cee-6eca-43eb-bc2d-292b2f5e5390-kube-api-access-dbfx9" (OuterVolumeSpecName: "kube-api-access-dbfx9") pod "c86f5cee-6eca-43eb-bc2d-292b2f5e5390" (UID: "c86f5cee-6eca-43eb-bc2d-292b2f5e5390"). InnerVolumeSpecName "kube-api-access-dbfx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:00:01.015981 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:01.015946    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c86f5cee-6eca-43eb-bc2d-292b2f5e5390-plugins-config-volume\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:00:01.016150 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:01.015999    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbfx9\" (UniqueName: \"kubernetes.io/projected/c86f5cee-6eca-43eb-bc2d-292b2f5e5390-kube-api-access-dbfx9\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:00:01.461236 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:01.461196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-80fa7537-29823000-l6fnm" event={"ID":"e8091401-be47-4ec5-983d-47c233654acd","Type":"ContainerStarted","Data":"9c3c7583f4a326a24e89ce390eeef03aa1ade417344345d79638c5b166d0726f"}
Sep 14 10:00:01.462537 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:01.462511    2581 generic.go:356] "Generic (PLEG): container finished" podID="c86f5cee-6eca-43eb-bc2d-292b2f5e5390" containerID="726e24bf8a4be5b1a1a7c2589d6058faec05878637a55eac143efc1e8784fd24" exitCode=0
Sep 14 10:00:01.462676 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:01.462547    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x" event={"ID":"c86f5cee-6eca-43eb-bc2d-292b2f5e5390","Type":"ContainerDied","Data":"726e24bf8a4be5b1a1a7c2589d6058faec05878637a55eac143efc1e8784fd24"}
Sep 14 10:00:01.462676 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:01.462560    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x"
Sep 14 10:00:01.462676 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:01.462580    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x" event={"ID":"c86f5cee-6eca-43eb-bc2d-292b2f5e5390","Type":"ContainerDied","Data":"cd5352690646b4cee673e849b468cbfbf42ddd1308b8416f4a1bed3e29c08b0e"}
Sep 14 10:00:01.462676 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:01.462602    2581 scope.go:117] "RemoveContainer" containerID="726e24bf8a4be5b1a1a7c2589d6058faec05878637a55eac143efc1e8784fd24"
Sep 14 10:00:01.472753 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:01.472723    2581 scope.go:117] "RemoveContainer" containerID="726e24bf8a4be5b1a1a7c2589d6058faec05878637a55eac143efc1e8784fd24"
Sep 14 10:00:01.473083 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:00:01.473060    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"726e24bf8a4be5b1a1a7c2589d6058faec05878637a55eac143efc1e8784fd24\": container with ID starting with 726e24bf8a4be5b1a1a7c2589d6058faec05878637a55eac143efc1e8784fd24 not found: ID does not exist" containerID="726e24bf8a4be5b1a1a7c2589d6058faec05878637a55eac143efc1e8784fd24"
Sep 14 10:00:01.473158 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:01.473098    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"726e24bf8a4be5b1a1a7c2589d6058faec05878637a55eac143efc1e8784fd24"} err="failed to get container status \"726e24bf8a4be5b1a1a7c2589d6058faec05878637a55eac143efc1e8784fd24\": rpc error: code = NotFound desc = could not find container \"726e24bf8a4be5b1a1a7c2589d6058faec05878637a55eac143efc1e8784fd24\": container with ID starting with 726e24bf8a4be5b1a1a7c2589d6058faec05878637a55eac143efc1e8784fd24 not found: ID does not exist"
Sep 14 10:00:01.488204 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:01.488168    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x"]
Sep 14 10:00:01.493182 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:01.493147    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-80fa7537-74cbf9586f-2k26x"]
Sep 14 10:00:02.661485 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:02.661449    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c86f5cee-6eca-43eb-bc2d-292b2f5e5390" path="/var/lib/kubelet/pods/c86f5cee-6eca-43eb-bc2d-292b2f5e5390/volumes"
Sep 14 10:00:03.477780 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:03.477736    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-80fa7537-29823000-l6fnm" event={"ID":"e8091401-be47-4ec5-983d-47c233654acd","Type":"ContainerStarted","Data":"95faf65dcd7680e9abf33de189af2bd4172924e555ae7880b759b5bf80691f3f"}
Sep 14 10:00:03.477964 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:03.477824    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-80fa7537-29823000-l6fnm" podUID="e8091401-be47-4ec5-983d-47c233654acd" containerName="cleanup" containerID="cri-o://95faf65dcd7680e9abf33de189af2bd4172924e555ae7880b759b5bf80691f3f" gracePeriod=30
Sep 14 10:00:03.499248 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:03.499185    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-80fa7537-29823000-l6fnm" podStartSLOduration=0.977102841 podStartE2EDuration="3.499167602s" totalImagesPullingTime="2.522064761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:00:03.497789003 +0000 UTC m=+1019.356021368" watchObservedRunningTime="2026-09-14 10:00:03.499167602 +0000 UTC m=+1019.357399957"
Sep 14 10:00:04.034469 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:04.034441    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-80fa7537-29823000-l6fnm"
Sep 14 10:00:04.484082 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:04.484049    2581 generic.go:356] "Generic (PLEG): container finished" podID="e8091401-be47-4ec5-983d-47c233654acd" containerID="95faf65dcd7680e9abf33de189af2bd4172924e555ae7880b759b5bf80691f3f" exitCode=6
Sep 14 10:00:04.484281 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:04.484092    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-80fa7537-29823000-l6fnm" event={"ID":"e8091401-be47-4ec5-983d-47c233654acd","Type":"ContainerDied","Data":"95faf65dcd7680e9abf33de189af2bd4172924e555ae7880b759b5bf80691f3f"}
Sep 14 10:00:04.484281 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:04.484097    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-80fa7537-29823000-l6fnm"
Sep 14 10:00:04.484281 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:04.484144    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-80fa7537-29823000-l6fnm" event={"ID":"e8091401-be47-4ec5-983d-47c233654acd","Type":"ContainerDied","Data":"9c3c7583f4a326a24e89ce390eeef03aa1ade417344345d79638c5b166d0726f"}
Sep 14 10:00:04.484281 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:04.484174    2581 scope.go:117] "RemoveContainer" containerID="95faf65dcd7680e9abf33de189af2bd4172924e555ae7880b759b5bf80691f3f"
Sep 14 10:00:04.492921 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:04.492894    2581 scope.go:117] "RemoveContainer" containerID="95faf65dcd7680e9abf33de189af2bd4172924e555ae7880b759b5bf80691f3f"
Sep 14 10:00:04.493196 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:00:04.493174    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95faf65dcd7680e9abf33de189af2bd4172924e555ae7880b759b5bf80691f3f\": container with ID starting with 95faf65dcd7680e9abf33de189af2bd4172924e555ae7880b759b5bf80691f3f not found: ID does not exist" containerID="95faf65dcd7680e9abf33de189af2bd4172924e555ae7880b759b5bf80691f3f"
Sep 14 10:00:04.493263 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:04.493205    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95faf65dcd7680e9abf33de189af2bd4172924e555ae7880b759b5bf80691f3f"} err="failed to get container status \"95faf65dcd7680e9abf33de189af2bd4172924e555ae7880b759b5bf80691f3f\": rpc error: code = NotFound desc = could not find container \"95faf65dcd7680e9abf33de189af2bd4172924e555ae7880b759b5bf80691f3f\": container with ID starting with 95faf65dcd7680e9abf33de189af2bd4172924e555ae7880b759b5bf80691f3f not found: ID does not exist"
Sep 14 10:00:04.507596 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:04.507574    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-80fa7537-29823000-l6fnm"]
Sep 14 10:00:04.513421 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:04.513399    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-80fa7537-29823000-l6fnm"]
Sep 14 10:00:04.656354 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:04.656320    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8091401-be47-4ec5-983d-47c233654acd" path="/var/lib/kubelet/pods/e8091401-be47-4ec5-983d-47c233654acd/volumes"
Sep 14 10:00:10.662507 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:10.662474    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:00:12.207339 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.207297    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"]
Sep 14 10:00:12.207775 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.207649    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d" podUID="2c14846d-0cce-4a56-ba26-1c75b32172cc" containerName="maas-api" containerID="cri-o://9d70bc186a62c166bcaeb66b3cd71f5ae417d67de7da164e7365195524842e28" gracePeriod=30
Sep 14 10:00:12.263724 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.263677    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx"]
Sep 14 10:00:12.263995 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.263943    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx" podUID="6a0e0f04-6847-4730-afcb-d04c7a21207e" containerName="payload-processing" containerID="cri-o://6f16380c667c7169bd98cfebd5e97bfac4bcb4908d9a11c12926058714cc2427" gracePeriod=30
Sep 14 10:00:12.530241 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.530214    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"
Sep 14 10:00:12.533675 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.533649    2581 generic.go:356] "Generic (PLEG): container finished" podID="6a0e0f04-6847-4730-afcb-d04c7a21207e" containerID="6f16380c667c7169bd98cfebd5e97bfac4bcb4908d9a11c12926058714cc2427" exitCode=0
Sep 14 10:00:12.533788 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.533743    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx" event={"ID":"6a0e0f04-6847-4730-afcb-d04c7a21207e","Type":"ContainerDied","Data":"6f16380c667c7169bd98cfebd5e97bfac4bcb4908d9a11c12926058714cc2427"}
Sep 14 10:00:12.535345 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.535318    2581 generic.go:356] "Generic (PLEG): container finished" podID="2c14846d-0cce-4a56-ba26-1c75b32172cc" containerID="9d70bc186a62c166bcaeb66b3cd71f5ae417d67de7da164e7365195524842e28" exitCode=0
Sep 14 10:00:12.535423 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.535362    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"
Sep 14 10:00:12.535423 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.535371    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d" event={"ID":"2c14846d-0cce-4a56-ba26-1c75b32172cc","Type":"ContainerDied","Data":"9d70bc186a62c166bcaeb66b3cd71f5ae417d67de7da164e7365195524842e28"}
Sep 14 10:00:12.535423 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.535411    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d" event={"ID":"2c14846d-0cce-4a56-ba26-1c75b32172cc","Type":"ContainerDied","Data":"45f92c91336b3e847a568fd204d8a59a79a76cc2cddcdf2738a65a53eb019a81"}
Sep 14 10:00:12.535554 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.535433    2581 scope.go:117] "RemoveContainer" containerID="9d70bc186a62c166bcaeb66b3cd71f5ae417d67de7da164e7365195524842e28"
Sep 14 10:00:12.550184 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.550163    2581 scope.go:117] "RemoveContainer" containerID="9d70bc186a62c166bcaeb66b3cd71f5ae417d67de7da164e7365195524842e28"
Sep 14 10:00:12.550448 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:00:12.550424    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d70bc186a62c166bcaeb66b3cd71f5ae417d67de7da164e7365195524842e28\": container with ID starting with 9d70bc186a62c166bcaeb66b3cd71f5ae417d67de7da164e7365195524842e28 not found: ID does not exist" containerID="9d70bc186a62c166bcaeb66b3cd71f5ae417d67de7da164e7365195524842e28"
Sep 14 10:00:12.550550 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.550462    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d70bc186a62c166bcaeb66b3cd71f5ae417d67de7da164e7365195524842e28"} err="failed to get container status \"9d70bc186a62c166bcaeb66b3cd71f5ae417d67de7da164e7365195524842e28\": rpc error: code = NotFound desc = could not find container \"9d70bc186a62c166bcaeb66b3cd71f5ae417d67de7da164e7365195524842e28\": container with ID starting with 9d70bc186a62c166bcaeb66b3cd71f5ae417d67de7da164e7365195524842e28 not found: ID does not exist"
Sep 14 10:00:12.553881 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.553822    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx"
Sep 14 10:00:12.635652 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.635619    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7srmv\" (UniqueName: \"kubernetes.io/projected/6a0e0f04-6847-4730-afcb-d04c7a21207e-kube-api-access-7srmv\") pod \"6a0e0f04-6847-4730-afcb-d04c7a21207e\" (UID: \"6a0e0f04-6847-4730-afcb-d04c7a21207e\") "
Sep 14 10:00:12.635873 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.635728    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ws9fw\" (UniqueName: \"kubernetes.io/projected/2c14846d-0cce-4a56-ba26-1c75b32172cc-kube-api-access-ws9fw\") pod \"2c14846d-0cce-4a56-ba26-1c75b32172cc\" (UID: \"2c14846d-0cce-4a56-ba26-1c75b32172cc\") "
Sep 14 10:00:12.635873 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.635752    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c14846d-0cce-4a56-ba26-1c75b32172cc-openshift-service-ca\") pod \"2c14846d-0cce-4a56-ba26-1c75b32172cc\" (UID: \"2c14846d-0cce-4a56-ba26-1c75b32172cc\") "
Sep 14 10:00:12.635873 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.635769    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c14846d-0cce-4a56-ba26-1c75b32172cc-metrics-certs\") pod \"2c14846d-0cce-4a56-ba26-1c75b32172cc\" (UID: \"2c14846d-0cce-4a56-ba26-1c75b32172cc\") "
Sep 14 10:00:12.635873 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.635843    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a0e0f04-6847-4730-afcb-d04c7a21207e-plugins-config-volume\") pod \"6a0e0f04-6847-4730-afcb-d04c7a21207e\" (UID: \"6a0e0f04-6847-4730-afcb-d04c7a21207e\") "
Sep 14 10:00:12.636112 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.635895    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c14846d-0cce-4a56-ba26-1c75b32172cc-maas-api-tls\") pod \"2c14846d-0cce-4a56-ba26-1c75b32172cc\" (UID: \"2c14846d-0cce-4a56-ba26-1c75b32172cc\") "
Sep 14 10:00:12.636197 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.636159    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c14846d-0cce-4a56-ba26-1c75b32172cc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2c14846d-0cce-4a56-ba26-1c75b32172cc" (UID: "2c14846d-0cce-4a56-ba26-1c75b32172cc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:00:12.636264 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.636249    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c14846d-0cce-4a56-ba26-1c75b32172cc-openshift-service-ca\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:00:12.636327 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.636261    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a0e0f04-6847-4730-afcb-d04c7a21207e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6a0e0f04-6847-4730-afcb-d04c7a21207e" (UID: "6a0e0f04-6847-4730-afcb-d04c7a21207e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:00:12.637927 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.637902    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c14846d-0cce-4a56-ba26-1c75b32172cc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2c14846d-0cce-4a56-ba26-1c75b32172cc" (UID: "2c14846d-0cce-4a56-ba26-1c75b32172cc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:00:12.638033 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.637934    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c14846d-0cce-4a56-ba26-1c75b32172cc-kube-api-access-ws9fw" (OuterVolumeSpecName: "kube-api-access-ws9fw") pod "2c14846d-0cce-4a56-ba26-1c75b32172cc" (UID: "2c14846d-0cce-4a56-ba26-1c75b32172cc"). InnerVolumeSpecName "kube-api-access-ws9fw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:00:12.638033 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.637951    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a0e0f04-6847-4730-afcb-d04c7a21207e-kube-api-access-7srmv" (OuterVolumeSpecName: "kube-api-access-7srmv") pod "6a0e0f04-6847-4730-afcb-d04c7a21207e" (UID: "6a0e0f04-6847-4730-afcb-d04c7a21207e"). InnerVolumeSpecName "kube-api-access-7srmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:00:12.638459 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.638426    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c14846d-0cce-4a56-ba26-1c75b32172cc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2c14846d-0cce-4a56-ba26-1c75b32172cc" (UID: "2c14846d-0cce-4a56-ba26-1c75b32172cc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:00:12.737777 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.737682    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ws9fw\" (UniqueName: \"kubernetes.io/projected/2c14846d-0cce-4a56-ba26-1c75b32172cc-kube-api-access-ws9fw\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:00:12.737777 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.737738    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c14846d-0cce-4a56-ba26-1c75b32172cc-metrics-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:00:12.737777 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.737753    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a0e0f04-6847-4730-afcb-d04c7a21207e-plugins-config-volume\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:00:12.737777 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.737767    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c14846d-0cce-4a56-ba26-1c75b32172cc-maas-api-tls\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:00:12.738087 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.737850    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7srmv\" (UniqueName: \"kubernetes.io/projected/6a0e0f04-6847-4730-afcb-d04c7a21207e-kube-api-access-7srmv\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:00:12.854828 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.854796    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"]
Sep 14 10:00:12.861723 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:12.861682    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8c98aa-757c9bfc8c-j4r6d"]
Sep 14 10:00:13.542531 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:13.542457    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx"
Sep 14 10:00:13.542964 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:13.542448    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx" event={"ID":"6a0e0f04-6847-4730-afcb-d04c7a21207e","Type":"ContainerDied","Data":"83f38688ca2730d11f39ee65d677f57cf87519f35d138d24b7d84881d8c0ecc9"}
Sep 14 10:00:13.542964 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:13.542595    2581 scope.go:117] "RemoveContainer" containerID="6f16380c667c7169bd98cfebd5e97bfac4bcb4908d9a11c12926058714cc2427"
Sep 14 10:00:13.576378 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:13.576343    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx"]
Sep 14 10:00:13.591938 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:13.591909    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-8c98aa-5f6cf59869-8nfzx"]
Sep 14 10:00:14.656650 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:14.656608    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c14846d-0cce-4a56-ba26-1c75b32172cc" path="/var/lib/kubelet/pods/2c14846d-0cce-4a56-ba26-1c75b32172cc/volumes"
Sep 14 10:00:14.657086 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:14.657063    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a0e0f04-6847-4730-afcb-d04c7a21207e" path="/var/lib/kubelet/pods/6a0e0f04-6847-4730-afcb-d04c7a21207e/volumes"
Sep 14 10:00:17.851692 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:17.851654    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"]
Sep 14 10:00:28.685500 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:28.685463    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:00:32.870881 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:32.870832    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt" podUID="0d4b908b-e5ee-492f-ab3d-688af183c9d2" containerName="main" containerID="cri-o://5e77c28cfa2b6cbce93b14c96a91b089054aded45ad79e9587e379aad08c3394" gracePeriod=45
Sep 14 10:00:33.129403 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.129336    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 10:00:33.226365 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.226331    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-dshm\") pod \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") "
Sep 14 10:00:33.226549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.226421    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d4b908b-e5ee-492f-ab3d-688af183c9d2-tls-certs\") pod \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") "
Sep 14 10:00:33.226549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.226443    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pvcj\" (UniqueName: \"kubernetes.io/projected/0d4b908b-e5ee-492f-ab3d-688af183c9d2-kube-api-access-8pvcj\") pod \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") "
Sep 14 10:00:33.226549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.226474    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-home\") pod \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") "
Sep 14 10:00:33.226549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.226500    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-tmp-dir\") pod \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") "
Sep 14 10:00:33.226549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.226524    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-model-cache\") pod \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\" (UID: \"0d4b908b-e5ee-492f-ab3d-688af183c9d2\") "
Sep 14 10:00:33.226860 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.226826    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-home" (OuterVolumeSpecName: "home") pod "0d4b908b-e5ee-492f-ab3d-688af183c9d2" (UID: "0d4b908b-e5ee-492f-ab3d-688af183c9d2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:00:33.226917 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.226847    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0d4b908b-e5ee-492f-ab3d-688af183c9d2" (UID: "0d4b908b-e5ee-492f-ab3d-688af183c9d2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:00:33.226917 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.226892    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-model-cache" (OuterVolumeSpecName: "model-cache") pod "0d4b908b-e5ee-492f-ab3d-688af183c9d2" (UID: "0d4b908b-e5ee-492f-ab3d-688af183c9d2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:00:33.228800 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.228774    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-dshm" (OuterVolumeSpecName: "dshm") pod "0d4b908b-e5ee-492f-ab3d-688af183c9d2" (UID: "0d4b908b-e5ee-492f-ab3d-688af183c9d2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:00:33.228800 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.228781    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d4b908b-e5ee-492f-ab3d-688af183c9d2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0d4b908b-e5ee-492f-ab3d-688af183c9d2" (UID: "0d4b908b-e5ee-492f-ab3d-688af183c9d2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:00:33.228958 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.228840    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d4b908b-e5ee-492f-ab3d-688af183c9d2-kube-api-access-8pvcj" (OuterVolumeSpecName: "kube-api-access-8pvcj") pod "0d4b908b-e5ee-492f-ab3d-688af183c9d2" (UID: "0d4b908b-e5ee-492f-ab3d-688af183c9d2"). InnerVolumeSpecName "kube-api-access-8pvcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:00:33.327649 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.327606    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-tmp-dir\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:00:33.327649 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.327643    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-model-cache\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:00:33.327649 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.327652    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-dshm\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:00:33.327649 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.327663    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d4b908b-e5ee-492f-ab3d-688af183c9d2-tls-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:00:33.327966 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.327673    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pvcj\" (UniqueName: \"kubernetes.io/projected/0d4b908b-e5ee-492f-ab3d-688af183c9d2-kube-api-access-8pvcj\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:00:33.327966 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.327682    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d4b908b-e5ee-492f-ab3d-688af183c9d2-home\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:00:33.648180 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.648144    2581 generic.go:356] "Generic (PLEG): container finished" podID="0d4b908b-e5ee-492f-ab3d-688af183c9d2" containerID="5e77c28cfa2b6cbce93b14c96a91b089054aded45ad79e9587e379aad08c3394" exitCode=0
Sep 14 10:00:33.648362 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.648187    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"
Sep 14 10:00:33.648362 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.648224    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt" event={"ID":"0d4b908b-e5ee-492f-ab3d-688af183c9d2","Type":"ContainerDied","Data":"5e77c28cfa2b6cbce93b14c96a91b089054aded45ad79e9587e379aad08c3394"}
Sep 14 10:00:33.648362 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.648264    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt" event={"ID":"0d4b908b-e5ee-492f-ab3d-688af183c9d2","Type":"ContainerDied","Data":"bcf808d0d54fff9ee3ea1d92d7a59e03d9bf5d2674fbfed0481ad2de3d1a802e"}
Sep 14 10:00:33.648362 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.648296    2581 scope.go:117] "RemoveContainer" containerID="5e77c28cfa2b6cbce93b14c96a91b089054aded45ad79e9587e379aad08c3394"
Sep 14 10:00:33.657035 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.657015    2581 scope.go:117] "RemoveContainer" containerID="5e77c28cfa2b6cbce93b14c96a91b089054aded45ad79e9587e379aad08c3394"
Sep 14 10:00:33.657299 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:00:33.657281    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e77c28cfa2b6cbce93b14c96a91b089054aded45ad79e9587e379aad08c3394\": container with ID starting with 5e77c28cfa2b6cbce93b14c96a91b089054aded45ad79e9587e379aad08c3394 not found: ID does not exist" containerID="5e77c28cfa2b6cbce93b14c96a91b089054aded45ad79e9587e379aad08c3394"
Sep 14 10:00:33.657347 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.657309    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e77c28cfa2b6cbce93b14c96a91b089054aded45ad79e9587e379aad08c3394"} err="failed to get container status \"5e77c28cfa2b6cbce93b14c96a91b089054aded45ad79e9587e379aad08c3394\": rpc error: code = NotFound desc = could not find container \"5e77c28cfa2b6cbce93b14c96a91b089054aded45ad79e9587e379aad08c3394\": container with ID starting with 5e77c28cfa2b6cbce93b14c96a91b089054aded45ad79e9587e379aad08c3394 not found: ID does not exist"
Sep 14 10:00:33.669791 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.669762    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"]
Sep 14 10:00:33.674064 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:33.674039    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-8c98aa/autores-model-8c98aa-kserve-8cf7d8967-82rbt"]
Sep 14 10:00:34.656063 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:34.656024    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d4b908b-e5ee-492f-ab3d-688af183c9d2" path="/var/lib/kubelet/pods/0d4b908b-e5ee-492f-ab3d-688af183c9d2/volumes"
Sep 14 10:00:41.365493 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.365455    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"]
Sep 14 10:00:41.366073 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.366051    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a0e0f04-6847-4730-afcb-d04c7a21207e" containerName="payload-processing"
Sep 14 10:00:41.366155 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.366076    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a0e0f04-6847-4730-afcb-d04c7a21207e" containerName="payload-processing"
Sep 14 10:00:41.366155 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.366090    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c86f5cee-6eca-43eb-bc2d-292b2f5e5390" containerName="payload-processing"
Sep 14 10:00:41.366155 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.366099    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c86f5cee-6eca-43eb-bc2d-292b2f5e5390" containerName="payload-processing"
Sep 14 10:00:41.366155 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.366111    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c14846d-0cce-4a56-ba26-1c75b32172cc" containerName="maas-api"
Sep 14 10:00:41.366155 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.366121    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c14846d-0cce-4a56-ba26-1c75b32172cc" containerName="maas-api"
Sep 14 10:00:41.366155 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.366131    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d4b908b-e5ee-492f-ab3d-688af183c9d2" containerName="main"
Sep 14 10:00:41.366155 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.366139    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d4b908b-e5ee-492f-ab3d-688af183c9d2" containerName="main"
Sep 14 10:00:41.366492 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.366181    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8091401-be47-4ec5-983d-47c233654acd" containerName="cleanup"
Sep 14 10:00:41.366492 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.366191    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8091401-be47-4ec5-983d-47c233654acd" containerName="cleanup"
Sep 14 10:00:41.366492 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.366284    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d4b908b-e5ee-492f-ab3d-688af183c9d2" containerName="main"
Sep 14 10:00:41.366492 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.366295    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c86f5cee-6eca-43eb-bc2d-292b2f5e5390" containerName="payload-processing"
Sep 14 10:00:41.366492 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.366307    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c14846d-0cce-4a56-ba26-1c75b32172cc" containerName="maas-api"
Sep 14 10:00:41.366492 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.366318    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a0e0f04-6847-4730-afcb-d04c7a21207e" containerName="payload-processing"
Sep 14 10:00:41.366492 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.366328    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8091401-be47-4ec5-983d-47c233654acd" containerName="cleanup"
Sep 14 10:00:41.373905 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.373879    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:41.378393 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.378369    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-2901ec\"/\"kube-root-ca.crt\""
Sep 14 10:00:41.378537 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.378375    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-2901ec\"/\"default-dockercfg-2tscd\""
Sep 14 10:00:41.378537 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.378375    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-2901ec\"/\"premium-w4-2901ec-kserve-self-signed-certs\""
Sep 14 10:00:41.378537 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.378422    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-2901ec\"/\"openshift-service-ca.crt\""
Sep 14 10:00:41.378981 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.378961    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"]
Sep 14 10:00:41.406046 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.406006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-model-cache\") pod \"premium-w4-2901ec-kserve-c488b59f4-z8f5j\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") " pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:41.406046 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.406046    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-home\") pod \"premium-w4-2901ec-kserve-c488b59f4-z8f5j\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") " pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:41.406319 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.406126    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/190aceb5-32fc-4061-8c69-8e284c7591c9-tls-certs\") pod \"premium-w4-2901ec-kserve-c488b59f4-z8f5j\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") " pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:41.406319 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.406266    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xlr5\" (UniqueName: \"kubernetes.io/projected/190aceb5-32fc-4061-8c69-8e284c7591c9-kube-api-access-9xlr5\") pod \"premium-w4-2901ec-kserve-c488b59f4-z8f5j\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") " pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:41.406319 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.406307    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-tmp-dir\") pod \"premium-w4-2901ec-kserve-c488b59f4-z8f5j\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") " pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:41.406470 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.406369    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-dshm\") pod \"premium-w4-2901ec-kserve-c488b59f4-z8f5j\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") " pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:41.507560 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.507519    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xlr5\" (UniqueName: \"kubernetes.io/projected/190aceb5-32fc-4061-8c69-8e284c7591c9-kube-api-access-9xlr5\") pod \"premium-w4-2901ec-kserve-c488b59f4-z8f5j\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") " pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:41.507560 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.507560    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-tmp-dir\") pod \"premium-w4-2901ec-kserve-c488b59f4-z8f5j\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") " pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:41.507845 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.507815    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-dshm\") pod \"premium-w4-2901ec-kserve-c488b59f4-z8f5j\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") " pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:41.507907 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.507893    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-model-cache\") pod \"premium-w4-2901ec-kserve-c488b59f4-z8f5j\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") " pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:41.507970 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.507926    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-home\") pod \"premium-w4-2901ec-kserve-c488b59f4-z8f5j\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") " pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:41.508026 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.507985    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/190aceb5-32fc-4061-8c69-8e284c7591c9-tls-certs\") pod \"premium-w4-2901ec-kserve-c488b59f4-z8f5j\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") " pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:41.508026 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.508014    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-tmp-dir\") pod \"premium-w4-2901ec-kserve-c488b59f4-z8f5j\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") " pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:41.508206 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.508187    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-model-cache\") pod \"premium-w4-2901ec-kserve-c488b59f4-z8f5j\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") " pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:41.508275 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.508233    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-home\") pod \"premium-w4-2901ec-kserve-c488b59f4-z8f5j\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") " pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:41.509961 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.509940    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-dshm\") pod \"premium-w4-2901ec-kserve-c488b59f4-z8f5j\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") " pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:41.510482 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.510444    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/190aceb5-32fc-4061-8c69-8e284c7591c9-tls-certs\") pod \"premium-w4-2901ec-kserve-c488b59f4-z8f5j\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") " pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:41.516514 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.516482    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xlr5\" (UniqueName: \"kubernetes.io/projected/190aceb5-32fc-4061-8c69-8e284c7591c9-kube-api-access-9xlr5\") pod \"premium-w4-2901ec-kserve-c488b59f4-z8f5j\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") " pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:41.685346 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.685305    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:41.967936 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:41.967909    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"]
Sep 14 10:00:41.970508 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:00:41.970480    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod190aceb5_32fc_4061_8c69_8e284c7591c9.slice/crio-0683cf4fd4a95f7289417ce748913a2a52c14e00f61dde424028d575cf0a4404 WatchSource:0}: Error finding container 0683cf4fd4a95f7289417ce748913a2a52c14e00f61dde424028d575cf0a4404: Status 404 returned error can't find the container with id 0683cf4fd4a95f7289417ce748913a2a52c14e00f61dde424028d575cf0a4404
Sep 14 10:00:42.697021 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:42.696977    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j" event={"ID":"190aceb5-32fc-4061-8c69-8e284c7591c9","Type":"ContainerStarted","Data":"e54897c4eeaf6e05711b3b697d01e0d39b32d6efa35ece18f0542cfdcf9b53aa"}
Sep 14 10:00:42.697021 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:42.697028    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j" event={"ID":"190aceb5-32fc-4061-8c69-8e284c7591c9","Type":"ContainerStarted","Data":"0683cf4fd4a95f7289417ce748913a2a52c14e00f61dde424028d575cf0a4404"}
Sep 14 10:00:42.717734 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:42.717658    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j" podStartSLOduration=1.7176428540000002 podStartE2EDuration="1.717642854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:00:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:00:42.716673533 +0000 UTC m=+1058.574905904" watchObservedRunningTime="2026-09-14 10:00:42.717642854 +0000 UTC m=+1058.575875210"
Sep 14 10:00:46.634061 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:46.634013    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:00:47.965135 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:47.965097    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"]
Sep 14 10:00:47.968885 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:47.968859    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:47.973369 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:47.973345    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-b6812e\"/\"default-dockercfg-grxrg\""
Sep 14 10:00:47.973499 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:47.973342    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-b6812e\"/\"openshift-service-ca.crt\""
Sep 14 10:00:47.973499 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:47.973347    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-b6812e\"/\"kube-root-ca.crt\""
Sep 14 10:00:47.973499 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:47.973399    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-b6812e\"/\"premium-w0-b6812e-kserve-self-signed-certs\""
Sep 14 10:00:47.980603 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:47.980580    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"]
Sep 14 10:00:48.073955 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.073917    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2w2d\" (UniqueName: \"kubernetes.io/projected/674dc0c9-b738-4844-8b73-25381039ac2f-kube-api-access-f2w2d\") pod \"premium-w0-b6812e-kserve-7fdfc4b54-xtc6s\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") " pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:48.074179 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.073965    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-home\") pod \"premium-w0-b6812e-kserve-7fdfc4b54-xtc6s\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") " pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:48.074179 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.074077    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-dshm\") pod \"premium-w0-b6812e-kserve-7fdfc4b54-xtc6s\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") " pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:48.074179 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.074115    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/674dc0c9-b738-4844-8b73-25381039ac2f-tls-certs\") pod \"premium-w0-b6812e-kserve-7fdfc4b54-xtc6s\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") " pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:48.074179 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.074163    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-model-cache\") pod \"premium-w0-b6812e-kserve-7fdfc4b54-xtc6s\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") " pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:48.074353 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.074266    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-tmp-dir\") pod \"premium-w0-b6812e-kserve-7fdfc4b54-xtc6s\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") " pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:48.175043 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.175005    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-tmp-dir\") pod \"premium-w0-b6812e-kserve-7fdfc4b54-xtc6s\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") " pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:48.175207 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.175058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2w2d\" (UniqueName: \"kubernetes.io/projected/674dc0c9-b738-4844-8b73-25381039ac2f-kube-api-access-f2w2d\") pod \"premium-w0-b6812e-kserve-7fdfc4b54-xtc6s\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") " pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:48.175207 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.175081    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-home\") pod \"premium-w0-b6812e-kserve-7fdfc4b54-xtc6s\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") " pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:48.175207 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.175127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-dshm\") pod \"premium-w0-b6812e-kserve-7fdfc4b54-xtc6s\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") " pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:48.175207 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.175144    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/674dc0c9-b738-4844-8b73-25381039ac2f-tls-certs\") pod \"premium-w0-b6812e-kserve-7fdfc4b54-xtc6s\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") " pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:48.175429 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.175297    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-model-cache\") pod \"premium-w0-b6812e-kserve-7fdfc4b54-xtc6s\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") " pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:48.175504 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.175483    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-tmp-dir\") pod \"premium-w0-b6812e-kserve-7fdfc4b54-xtc6s\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") " pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:48.175551 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.175519    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-home\") pod \"premium-w0-b6812e-kserve-7fdfc4b54-xtc6s\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") " pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:48.175634 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.175616    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-model-cache\") pod \"premium-w0-b6812e-kserve-7fdfc4b54-xtc6s\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") " pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:48.177441 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.177421    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-dshm\") pod \"premium-w0-b6812e-kserve-7fdfc4b54-xtc6s\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") " pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:48.177532 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.177516    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/674dc0c9-b738-4844-8b73-25381039ac2f-tls-certs\") pod \"premium-w0-b6812e-kserve-7fdfc4b54-xtc6s\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") " pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:48.185784 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.185758    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2w2d\" (UniqueName: \"kubernetes.io/projected/674dc0c9-b738-4844-8b73-25381039ac2f-kube-api-access-f2w2d\") pod \"premium-w0-b6812e-kserve-7fdfc4b54-xtc6s\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") " pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:48.279225 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.279133    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:48.560574 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.560545    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"]
Sep 14 10:00:48.561990 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:00:48.561960    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod674dc0c9_b738_4844_8b73_25381039ac2f.slice/crio-d75333a11c2ab5f7d84927f7304ea40038988b26969c65695b335e152642891b WatchSource:0}: Error finding container d75333a11c2ab5f7d84927f7304ea40038988b26969c65695b335e152642891b: Status 404 returned error can't find the container with id d75333a11c2ab5f7d84927f7304ea40038988b26969c65695b335e152642891b
Sep 14 10:00:48.731598 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.731555    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s" event={"ID":"674dc0c9-b738-4844-8b73-25381039ac2f","Type":"ContainerStarted","Data":"767c63024e57e911c7eb89c1150bf239de26b6b165cb3eca989168875defb22d"}
Sep 14 10:00:48.731835 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.731609    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s" event={"ID":"674dc0c9-b738-4844-8b73-25381039ac2f","Type":"ContainerStarted","Data":"d75333a11c2ab5f7d84927f7304ea40038988b26969c65695b335e152642891b"}
Sep 14 10:00:48.764013 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:48.763949    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s" podStartSLOduration=1.763929833 podStartE2EDuration="1.763929833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:00:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:00:48.763389303 +0000 UTC m=+1064.621621658" watchObservedRunningTime="2026-09-14 10:00:48.763929833 +0000 UTC m=+1064.622162197"
Sep 14 10:00:51.685936 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:51.685879    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:51.686391 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:51.685964    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:51.698896 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:51.698865    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:51.758226 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:51.758189    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:00:58.280290 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:58.280197    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:58.280290 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:58.280268    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:58.292973 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:58.292940    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:00:58.802132 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:00:58.802102    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:01:00.697769 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:00.697726    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:01:06.365279 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:06.365237    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"]
Sep 14 10:01:06.371161 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:06.371133    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"
Sep 14 10:01:06.374288 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:06.374259    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-31f3b6-serving-cert\""
Sep 14 10:01:06.383197 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:06.383168    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"]
Sep 14 10:01:06.559989 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:06.559931    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e728ccad-4727-4331-8d42-81346f09dd26-maas-api-tls\") pod \"maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq\" (UID: \"e728ccad-4727-4331-8d42-81346f09dd26\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"
Sep 14 10:01:06.560183 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:06.560079    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e728ccad-4727-4331-8d42-81346f09dd26-openshift-service-ca\") pod \"maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq\" (UID: \"e728ccad-4727-4331-8d42-81346f09dd26\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"
Sep 14 10:01:06.560183 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:06.560120    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e728ccad-4727-4331-8d42-81346f09dd26-metrics-certs\") pod \"maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq\" (UID: \"e728ccad-4727-4331-8d42-81346f09dd26\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"
Sep 14 10:01:06.560183 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:06.560165    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b9d6\" (UniqueName: \"kubernetes.io/projected/e728ccad-4727-4331-8d42-81346f09dd26-kube-api-access-6b9d6\") pod \"maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq\" (UID: \"e728ccad-4727-4331-8d42-81346f09dd26\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"
Sep 14 10:01:06.661241 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:06.661142    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b9d6\" (UniqueName: \"kubernetes.io/projected/e728ccad-4727-4331-8d42-81346f09dd26-kube-api-access-6b9d6\") pod \"maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq\" (UID: \"e728ccad-4727-4331-8d42-81346f09dd26\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"
Sep 14 10:01:06.661241 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:06.661218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e728ccad-4727-4331-8d42-81346f09dd26-maas-api-tls\") pod \"maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq\" (UID: \"e728ccad-4727-4331-8d42-81346f09dd26\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"
Sep 14 10:01:06.661492 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:06.661270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e728ccad-4727-4331-8d42-81346f09dd26-openshift-service-ca\") pod \"maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq\" (UID: \"e728ccad-4727-4331-8d42-81346f09dd26\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"
Sep 14 10:01:06.661492 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:06.661289    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e728ccad-4727-4331-8d42-81346f09dd26-metrics-certs\") pod \"maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq\" (UID: \"e728ccad-4727-4331-8d42-81346f09dd26\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"
Sep 14 10:01:06.662083 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:06.662045    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e728ccad-4727-4331-8d42-81346f09dd26-openshift-service-ca\") pod \"maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq\" (UID: \"e728ccad-4727-4331-8d42-81346f09dd26\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"
Sep 14 10:01:06.663910 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:06.663882    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e728ccad-4727-4331-8d42-81346f09dd26-metrics-certs\") pod \"maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq\" (UID: \"e728ccad-4727-4331-8d42-81346f09dd26\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"
Sep 14 10:01:06.663910 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:06.663908    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e728ccad-4727-4331-8d42-81346f09dd26-maas-api-tls\") pod \"maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq\" (UID: \"e728ccad-4727-4331-8d42-81346f09dd26\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"
Sep 14 10:01:06.670306 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:06.670284    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b9d6\" (UniqueName: \"kubernetes.io/projected/e728ccad-4727-4331-8d42-81346f09dd26-kube-api-access-6b9d6\") pod \"maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq\" (UID: \"e728ccad-4727-4331-8d42-81346f09dd26\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"
Sep 14 10:01:06.684289 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:06.684257    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"
Sep 14 10:01:06.969482 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:06.969454    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"]
Sep 14 10:01:06.971350 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:01:06.971320    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode728ccad_4727_4331_8d42_81346f09dd26.slice/crio-001176d13d2fc3c2e6a82dfcad52ce935169266a0d48e76250a415d6c52d7afb WatchSource:0}: Error finding container 001176d13d2fc3c2e6a82dfcad52ce935169266a0d48e76250a415d6c52d7afb: Status 404 returned error can't find the container with id 001176d13d2fc3c2e6a82dfcad52ce935169266a0d48e76250a415d6c52d7afb
Sep 14 10:01:07.123858 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:07.123812    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267"]
Sep 14 10:01:07.128520 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:07.128492    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267"
Sep 14 10:01:07.131430 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:07.131408    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-31f3b6\""
Sep 14 10:01:07.140365 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:07.140338    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267"]
Sep 14 10:01:07.268879 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:07.268782    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpmqb\" (UniqueName: \"kubernetes.io/projected/0f8ea982-e474-40bc-bad8-dfd7da802881-kube-api-access-dpmqb\") pod \"payload-processing-e2e-explicit-31f3b6-75454845df-wq267\" (UID: \"0f8ea982-e474-40bc-bad8-dfd7da802881\") " pod="openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267"
Sep 14 10:01:07.269067 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:07.268916    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f8ea982-e474-40bc-bad8-dfd7da802881-plugins-config-volume\") pod \"payload-processing-e2e-explicit-31f3b6-75454845df-wq267\" (UID: \"0f8ea982-e474-40bc-bad8-dfd7da802881\") " pod="openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267"
Sep 14 10:01:07.370283 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:07.370233    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpmqb\" (UniqueName: \"kubernetes.io/projected/0f8ea982-e474-40bc-bad8-dfd7da802881-kube-api-access-dpmqb\") pod \"payload-processing-e2e-explicit-31f3b6-75454845df-wq267\" (UID: \"0f8ea982-e474-40bc-bad8-dfd7da802881\") " pod="openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267"
Sep 14 10:01:07.370801 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:07.370317    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f8ea982-e474-40bc-bad8-dfd7da802881-plugins-config-volume\") pod \"payload-processing-e2e-explicit-31f3b6-75454845df-wq267\" (UID: \"0f8ea982-e474-40bc-bad8-dfd7da802881\") " pod="openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267"
Sep 14 10:01:07.371017 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:07.370998    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f8ea982-e474-40bc-bad8-dfd7da802881-plugins-config-volume\") pod \"payload-processing-e2e-explicit-31f3b6-75454845df-wq267\" (UID: \"0f8ea982-e474-40bc-bad8-dfd7da802881\") " pod="openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267"
Sep 14 10:01:07.380482 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:07.380456    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpmqb\" (UniqueName: \"kubernetes.io/projected/0f8ea982-e474-40bc-bad8-dfd7da802881-kube-api-access-dpmqb\") pod \"payload-processing-e2e-explicit-31f3b6-75454845df-wq267\" (UID: \"0f8ea982-e474-40bc-bad8-dfd7da802881\") " pod="openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267"
Sep 14 10:01:07.441076 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:07.441037    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267"
Sep 14 10:01:07.721763 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:07.721731    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267"]
Sep 14 10:01:07.722252 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:01:07.722226    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f8ea982_e474_40bc_bad8_dfd7da802881.slice/crio-42692da46b2b6bc31771ff165d616d73bb4d24922db3ad590eb09b7f62b967e9 WatchSource:0}: Error finding container 42692da46b2b6bc31771ff165d616d73bb4d24922db3ad590eb09b7f62b967e9: Status 404 returned error can't find the container with id 42692da46b2b6bc31771ff165d616d73bb4d24922db3ad590eb09b7f62b967e9
Sep 14 10:01:07.854508 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:07.853753    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267" event={"ID":"0f8ea982-e474-40bc-bad8-dfd7da802881","Type":"ContainerStarted","Data":"79f72a9ba7b40ea8c8711057e75ded9c60ada07bec0f025052ecb3a2a496aeb9"}
Sep 14 10:01:07.854508 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:07.853889    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267" event={"ID":"0f8ea982-e474-40bc-bad8-dfd7da802881","Type":"ContainerStarted","Data":"42692da46b2b6bc31771ff165d616d73bb4d24922db3ad590eb09b7f62b967e9"}
Sep 14 10:01:07.854508 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:07.854004    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267"
Sep 14 10:01:07.855768 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:07.855740    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq" event={"ID":"e728ccad-4727-4331-8d42-81346f09dd26","Type":"ContainerStarted","Data":"e9da5940b95a4843ec96e7223376992c30354b935eaeed33d0604f33a3578ab9"}
Sep 14 10:01:07.855896 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:07.855783    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq" event={"ID":"e728ccad-4727-4331-8d42-81346f09dd26","Type":"ContainerStarted","Data":"001176d13d2fc3c2e6a82dfcad52ce935169266a0d48e76250a415d6c52d7afb"}
Sep 14 10:01:07.855896 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:07.855812    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"
Sep 14 10:01:07.875980 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:07.875914    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267" podStartSLOduration=0.875897003 podStartE2EDuration="875.897003ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:01:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:01:07.873238953 +0000 UTC m=+1083.731471333" watchObservedRunningTime="2026-09-14 10:01:07.875897003 +0000 UTC m=+1083.734129358"
Sep 14 10:01:07.893491 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:07.893430    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq" podStartSLOduration=1.386160868 podStartE2EDuration="1.893411005s" totalImagesPullingTime="507.250137ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:01:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:01:07.892077543 +0000 UTC m=+1083.750309896" watchObservedRunningTime="2026-09-14 10:01:07.893411005 +0000 UTC m=+1083.751643418"
Sep 14 10:01:13.867938 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:13.867900    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"
Sep 14 10:01:16.292256 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:16.292214    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:01:18.863650 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:18.863618    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267"
Sep 14 10:01:35.609498 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:35.609460    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:01:48.270389 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.270351    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"]
Sep 14 10:01:48.275197 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.275176    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:48.280269 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.280241    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-2901ec\"/\"e2e-conflict-a-c109e646-kserve-self-signed-certs\""
Sep 14 10:01:48.292426 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.292395    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"]
Sep 14 10:01:48.376180 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.376146    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpzjp\" (UniqueName: \"kubernetes.io/projected/31916249-ef6f-4246-bf6f-907cc0ebc649-kube-api-access-lpzjp\") pod \"e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") " pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:48.376345 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.376215    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-home\") pod \"e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") " pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:48.376345 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.376244    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31916249-ef6f-4246-bf6f-907cc0ebc649-tls-certs\") pod \"e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") " pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:48.376345 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.376294    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-model-cache\") pod \"e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") " pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:48.376345 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.376315    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-tmp-dir\") pod \"e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") " pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:48.376489 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.376345    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-dshm\") pod \"e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") " pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:48.477545 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.477507    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-model-cache\") pod \"e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") " pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:48.477545 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.477547    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-tmp-dir\") pod \"e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") " pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:48.477793 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.477577    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-dshm\") pod \"e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") " pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:48.477793 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.477630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpzjp\" (UniqueName: \"kubernetes.io/projected/31916249-ef6f-4246-bf6f-907cc0ebc649-kube-api-access-lpzjp\") pod \"e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") " pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:48.477793 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.477682    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-home\") pod \"e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") " pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:48.477793 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.477737    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31916249-ef6f-4246-bf6f-907cc0ebc649-tls-certs\") pod \"e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") " pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:48.478043 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.478012    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-model-cache\") pod \"e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") " pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:48.478103 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.478054    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-tmp-dir\") pod \"e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") " pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:48.478148 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.478120    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-home\") pod \"e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") " pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:48.480190 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.480159    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-dshm\") pod \"e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") " pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:48.480349 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.480331    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31916249-ef6f-4246-bf6f-907cc0ebc649-tls-certs\") pod \"e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") " pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:48.490123 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.490086    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpzjp\" (UniqueName: \"kubernetes.io/projected/31916249-ef6f-4246-bf6f-907cc0ebc649-kube-api-access-lpzjp\") pod \"e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") " pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:48.585772 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.585683    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:48.866186 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:48.866157    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"]
Sep 14 10:01:48.867799 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:01:48.867765    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31916249_ef6f_4246_bf6f_907cc0ebc649.slice/crio-98524b308019e4f548397a5782027dcdf723bc59ea425fd54576c86ccebfd687 WatchSource:0}: Error finding container 98524b308019e4f548397a5782027dcdf723bc59ea425fd54576c86ccebfd687: Status 404 returned error can't find the container with id 98524b308019e4f548397a5782027dcdf723bc59ea425fd54576c86ccebfd687
Sep 14 10:01:49.077412 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:49.077376    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l" event={"ID":"31916249-ef6f-4246-bf6f-907cc0ebc649","Type":"ContainerStarted","Data":"24acfabb601cfc327f4bf73516e0f4ff07e7de224ce725e82084a090aa848b93"}
Sep 14 10:01:49.077612 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:49.077421    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l" event={"ID":"31916249-ef6f-4246-bf6f-907cc0ebc649","Type":"ContainerStarted","Data":"98524b308019e4f548397a5782027dcdf723bc59ea425fd54576c86ccebfd687"}
Sep 14 10:01:49.100645 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:49.100592    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l" podStartSLOduration=1.100572893 podStartE2EDuration="1.100572893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:01:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:01:49.099009742 +0000 UTC m=+1124.957242099" watchObservedRunningTime="2026-09-14 10:01:49.100572893 +0000 UTC m=+1124.958805249"
Sep 14 10:01:58.586299 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:58.586253    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:58.586759 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:58.586520    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:58.600726 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:58.600689    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:01:59.146950 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:01:59.146917    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:02:06.198482 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:06.198438    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:02:41.698668 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:41.698584    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:02:42.350787 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.350751    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"]
Sep 14 10:02:42.351027 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.350980    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq" podUID="e728ccad-4727-4331-8d42-81346f09dd26" containerName="maas-api" containerID="cri-o://e9da5940b95a4843ec96e7223376992c30354b935eaeed33d0604f33a3578ab9" gracePeriod=30
Sep 14 10:02:42.421273 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.421230    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267"]
Sep 14 10:02:42.421516 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.421489    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267" podUID="0f8ea982-e474-40bc-bad8-dfd7da802881" containerName="payload-processing" containerID="cri-o://79f72a9ba7b40ea8c8711057e75ded9c60ada07bec0f025052ecb3a2a496aeb9" gracePeriod=30
Sep 14 10:02:42.693042 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.693012    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"
Sep 14 10:02:42.728286 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.728257    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267"
Sep 14 10:02:42.745169 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.745135    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6b9d6\" (UniqueName: \"kubernetes.io/projected/e728ccad-4727-4331-8d42-81346f09dd26-kube-api-access-6b9d6\") pod \"e728ccad-4727-4331-8d42-81346f09dd26\" (UID: \"e728ccad-4727-4331-8d42-81346f09dd26\") "
Sep 14 10:02:42.745351 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.745188    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e728ccad-4727-4331-8d42-81346f09dd26-metrics-certs\") pod \"e728ccad-4727-4331-8d42-81346f09dd26\" (UID: \"e728ccad-4727-4331-8d42-81346f09dd26\") "
Sep 14 10:02:42.745351 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.745303    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e728ccad-4727-4331-8d42-81346f09dd26-maas-api-tls\") pod \"e728ccad-4727-4331-8d42-81346f09dd26\" (UID: \"e728ccad-4727-4331-8d42-81346f09dd26\") "
Sep 14 10:02:42.745461 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.745391    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e728ccad-4727-4331-8d42-81346f09dd26-openshift-service-ca\") pod \"e728ccad-4727-4331-8d42-81346f09dd26\" (UID: \"e728ccad-4727-4331-8d42-81346f09dd26\") "
Sep 14 10:02:42.745842 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.745804    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e728ccad-4727-4331-8d42-81346f09dd26-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e728ccad-4727-4331-8d42-81346f09dd26" (UID: "e728ccad-4727-4331-8d42-81346f09dd26"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:02:42.745981 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.745892    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e728ccad-4727-4331-8d42-81346f09dd26-openshift-service-ca\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:02:42.747744 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.747684    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e728ccad-4727-4331-8d42-81346f09dd26-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e728ccad-4727-4331-8d42-81346f09dd26" (UID: "e728ccad-4727-4331-8d42-81346f09dd26"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:02:42.747744 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.747736    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e728ccad-4727-4331-8d42-81346f09dd26-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e728ccad-4727-4331-8d42-81346f09dd26" (UID: "e728ccad-4727-4331-8d42-81346f09dd26"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:02:42.747918 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.747891    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e728ccad-4727-4331-8d42-81346f09dd26-kube-api-access-6b9d6" (OuterVolumeSpecName: "kube-api-access-6b9d6") pod "e728ccad-4727-4331-8d42-81346f09dd26" (UID: "e728ccad-4727-4331-8d42-81346f09dd26"). InnerVolumeSpecName "kube-api-access-6b9d6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:02:42.846927 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.846885    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f8ea982-e474-40bc-bad8-dfd7da802881-plugins-config-volume\") pod \"0f8ea982-e474-40bc-bad8-dfd7da802881\" (UID: \"0f8ea982-e474-40bc-bad8-dfd7da802881\") "
Sep 14 10:02:42.847110 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.846947    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpmqb\" (UniqueName: \"kubernetes.io/projected/0f8ea982-e474-40bc-bad8-dfd7da802881-kube-api-access-dpmqb\") pod \"0f8ea982-e474-40bc-bad8-dfd7da802881\" (UID: \"0f8ea982-e474-40bc-bad8-dfd7da802881\") "
Sep 14 10:02:42.847266 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.847253    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6b9d6\" (UniqueName: \"kubernetes.io/projected/e728ccad-4727-4331-8d42-81346f09dd26-kube-api-access-6b9d6\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:02:42.847306 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.847269    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e728ccad-4727-4331-8d42-81346f09dd26-metrics-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:02:42.847306 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.847284    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e728ccad-4727-4331-8d42-81346f09dd26-maas-api-tls\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:02:42.847378 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.847356    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f8ea982-e474-40bc-bad8-dfd7da802881-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0f8ea982-e474-40bc-bad8-dfd7da802881" (UID: "0f8ea982-e474-40bc-bad8-dfd7da802881"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:02:42.849215 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.849180    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f8ea982-e474-40bc-bad8-dfd7da802881-kube-api-access-dpmqb" (OuterVolumeSpecName: "kube-api-access-dpmqb") pod "0f8ea982-e474-40bc-bad8-dfd7da802881" (UID: "0f8ea982-e474-40bc-bad8-dfd7da802881"). InnerVolumeSpecName "kube-api-access-dpmqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:02:42.948379 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.948340    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f8ea982-e474-40bc-bad8-dfd7da802881-plugins-config-volume\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:02:42.948379 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:42.948374    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpmqb\" (UniqueName: \"kubernetes.io/projected/0f8ea982-e474-40bc-bad8-dfd7da802881-kube-api-access-dpmqb\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:02:43.378129 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:43.378091    2581 generic.go:356] "Generic (PLEG): container finished" podID="0f8ea982-e474-40bc-bad8-dfd7da802881" containerID="79f72a9ba7b40ea8c8711057e75ded9c60ada07bec0f025052ecb3a2a496aeb9" exitCode=0
Sep 14 10:02:43.378326 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:43.378149    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267"
Sep 14 10:02:43.378326 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:43.378183    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267" event={"ID":"0f8ea982-e474-40bc-bad8-dfd7da802881","Type":"ContainerDied","Data":"79f72a9ba7b40ea8c8711057e75ded9c60ada07bec0f025052ecb3a2a496aeb9"}
Sep 14 10:02:43.378326 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:43.378237    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267" event={"ID":"0f8ea982-e474-40bc-bad8-dfd7da802881","Type":"ContainerDied","Data":"42692da46b2b6bc31771ff165d616d73bb4d24922db3ad590eb09b7f62b967e9"}
Sep 14 10:02:43.378326 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:43.378265    2581 scope.go:117] "RemoveContainer" containerID="79f72a9ba7b40ea8c8711057e75ded9c60ada07bec0f025052ecb3a2a496aeb9"
Sep 14 10:02:43.379815 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:43.379764    2581 generic.go:356] "Generic (PLEG): container finished" podID="e728ccad-4727-4331-8d42-81346f09dd26" containerID="e9da5940b95a4843ec96e7223376992c30354b935eaeed33d0604f33a3578ab9" exitCode=0
Sep 14 10:02:43.379815 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:43.379805    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"
Sep 14 10:02:43.379920 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:43.379855    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq" event={"ID":"e728ccad-4727-4331-8d42-81346f09dd26","Type":"ContainerDied","Data":"e9da5940b95a4843ec96e7223376992c30354b935eaeed33d0604f33a3578ab9"}
Sep 14 10:02:43.379920 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:43.379912    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq" event={"ID":"e728ccad-4727-4331-8d42-81346f09dd26","Type":"ContainerDied","Data":"001176d13d2fc3c2e6a82dfcad52ce935169266a0d48e76250a415d6c52d7afb"}
Sep 14 10:02:43.388025 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:43.388002    2581 scope.go:117] "RemoveContainer" containerID="79f72a9ba7b40ea8c8711057e75ded9c60ada07bec0f025052ecb3a2a496aeb9"
Sep 14 10:02:43.388417 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:02:43.388342    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79f72a9ba7b40ea8c8711057e75ded9c60ada07bec0f025052ecb3a2a496aeb9\": container with ID starting with 79f72a9ba7b40ea8c8711057e75ded9c60ada07bec0f025052ecb3a2a496aeb9 not found: ID does not exist" containerID="79f72a9ba7b40ea8c8711057e75ded9c60ada07bec0f025052ecb3a2a496aeb9"
Sep 14 10:02:43.388417 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:43.388377    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79f72a9ba7b40ea8c8711057e75ded9c60ada07bec0f025052ecb3a2a496aeb9"} err="failed to get container status \"79f72a9ba7b40ea8c8711057e75ded9c60ada07bec0f025052ecb3a2a496aeb9\": rpc error: code = NotFound desc = could not find container \"79f72a9ba7b40ea8c8711057e75ded9c60ada07bec0f025052ecb3a2a496aeb9\": container with ID starting with 79f72a9ba7b40ea8c8711057e75ded9c60ada07bec0f025052ecb3a2a496aeb9 not found: ID does not exist"
Sep 14 10:02:43.388417 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:43.388401    2581 scope.go:117] "RemoveContainer" containerID="e9da5940b95a4843ec96e7223376992c30354b935eaeed33d0604f33a3578ab9"
Sep 14 10:02:43.398603 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:43.398567    2581 scope.go:117] "RemoveContainer" containerID="e9da5940b95a4843ec96e7223376992c30354b935eaeed33d0604f33a3578ab9"
Sep 14 10:02:43.399023 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:02:43.398992    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9da5940b95a4843ec96e7223376992c30354b935eaeed33d0604f33a3578ab9\": container with ID starting with e9da5940b95a4843ec96e7223376992c30354b935eaeed33d0604f33a3578ab9 not found: ID does not exist" containerID="e9da5940b95a4843ec96e7223376992c30354b935eaeed33d0604f33a3578ab9"
Sep 14 10:02:43.399107 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:43.399035    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9da5940b95a4843ec96e7223376992c30354b935eaeed33d0604f33a3578ab9"} err="failed to get container status \"e9da5940b95a4843ec96e7223376992c30354b935eaeed33d0604f33a3578ab9\": rpc error: code = NotFound desc = could not find container \"e9da5940b95a4843ec96e7223376992c30354b935eaeed33d0604f33a3578ab9\": container with ID starting with e9da5940b95a4843ec96e7223376992c30354b935eaeed33d0604f33a3578ab9 not found: ID does not exist"
Sep 14 10:02:43.406558 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:43.406528    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"]
Sep 14 10:02:43.409484 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:43.409454    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-31f3b6-b654fb4f-hzhxq"]
Sep 14 10:02:43.420680 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:43.420649    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267"]
Sep 14 10:02:43.427042 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:43.427009    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-31f3b6-75454845df-wq267"]
Sep 14 10:02:44.657004 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:44.656906    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f8ea982-e474-40bc-bad8-dfd7da802881" path="/var/lib/kubelet/pods/0f8ea982-e474-40bc-bad8-dfd7da802881/volumes"
Sep 14 10:02:44.657467 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:44.657346    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e728ccad-4727-4331-8d42-81346f09dd26" path="/var/lib/kubelet/pods/e728ccad-4727-4331-8d42-81346f09dd26/volumes"
Sep 14 10:02:50.550692 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.550656    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"]
Sep 14 10:02:50.551130 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.551114    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e728ccad-4727-4331-8d42-81346f09dd26" containerName="maas-api"
Sep 14 10:02:50.551178 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.551131    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e728ccad-4727-4331-8d42-81346f09dd26" containerName="maas-api"
Sep 14 10:02:50.551178 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.551158    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f8ea982-e474-40bc-bad8-dfd7da802881" containerName="payload-processing"
Sep 14 10:02:50.551178 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.551164    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f8ea982-e474-40bc-bad8-dfd7da802881" containerName="payload-processing"
Sep 14 10:02:50.551270 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.551228    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e728ccad-4727-4331-8d42-81346f09dd26" containerName="maas-api"
Sep 14 10:02:50.551270 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.551237    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f8ea982-e474-40bc-bad8-dfd7da802881" containerName="payload-processing"
Sep 14 10:02:50.560275 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.560241    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.563670 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.563647    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-938944-openshift-default-dockercfg-tn9ff\""
Sep 14 10:02:50.573214 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.573181    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"]
Sep 14 10:02:50.628877 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.628832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdczx\" (UniqueName: \"kubernetes.io/projected/7ee56093-1d28-4722-8222-ef5a305b5db5-kube-api-access-kdczx\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.629077 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.628883    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-workload-socket\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.629077 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.628931    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ee56093-1d28-4722-8222-ef5a305b5db5-istiod-ca-cert\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.629077 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.628951    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-envoy\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.629077 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.628980    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-podinfo\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.629319 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.629091    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-workload-certs\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.629319 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.629150    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-credential-socket\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.629319 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.629184    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-token\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.629319 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.629243    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-data\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.730821 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.730774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ee56093-1d28-4722-8222-ef5a305b5db5-istiod-ca-cert\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.730821 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.730821    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-envoy\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.731057 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.730854    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-podinfo\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.731057 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.730902    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-workload-certs\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.731057 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.730975    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-credential-socket\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.731057 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.731020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-token\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.731282 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.731083    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-data\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.731282 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.731165    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdczx\" (UniqueName: \"kubernetes.io/projected/7ee56093-1d28-4722-8222-ef5a305b5db5-kube-api-access-kdczx\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.731282 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.731210    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-workload-socket\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.731440 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.731334    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-workload-certs\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.731440 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.731401    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-credential-socket\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.731597 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.731577    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-workload-socket\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.731669 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.731610    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ee56093-1d28-4722-8222-ef5a305b5db5-istiod-ca-cert\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.731669 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.731656    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-data\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.733310 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.733289    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-envoy\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.733566 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.733544    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-podinfo\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.740787 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.740753    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-token\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.740946 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.740855    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdczx\" (UniqueName: \"kubernetes.io/projected/7ee56093-1d28-4722-8222-ef5a305b5db5-kube-api-access-kdczx\") pod \"e2e-noten-938944-openshift-default-68c4d79d66-cvrlk\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") " pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:50.872760 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:50.872646    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:51.166753 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:51.166695    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"]
Sep 14 10:02:51.168547 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:02:51.168518    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ee56093_1d28_4722_8222_ef5a305b5db5.slice/crio-3c675fea13a56e0afc60c29c65a469ef883791903edaf292a34461763cda1b30 WatchSource:0}: Error finding container 3c675fea13a56e0afc60c29c65a469ef883791903edaf292a34461763cda1b30: Status 404 returned error can't find the container with id 3c675fea13a56e0afc60c29c65a469ef883791903edaf292a34461763cda1b30
Sep 14 10:02:51.171345 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:51.171310    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 10:02:51.171463 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:51.171397    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 10:02:51.171463 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:51.171440    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 10:02:51.427810 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:51.427728    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk" event={"ID":"7ee56093-1d28-4722-8222-ef5a305b5db5","Type":"ContainerStarted","Data":"86c30cc10bcb767e62b3670bbaba7c864e99d71efe02275c39c0b589b29519ee"}
Sep 14 10:02:51.427810 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:51.427779    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk" event={"ID":"7ee56093-1d28-4722-8222-ef5a305b5db5","Type":"ContainerStarted","Data":"3c675fea13a56e0afc60c29c65a469ef883791903edaf292a34461763cda1b30"}
Sep 14 10:02:51.456774 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:51.456683    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk" podStartSLOduration=1.4566643479999999 podStartE2EDuration="1.456664348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:02:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:02:51.454592491 +0000 UTC m=+1187.312824846" watchObservedRunningTime="2026-09-14 10:02:51.456664348 +0000 UTC m=+1187.314896714"
Sep 14 10:02:51.873645 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:51.873598    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:52.879382 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:52.879349    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:53.438793 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:53.438757    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:02:53.439682 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:02:53.439657    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:03:01.762723 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:01.762669    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"]
Sep 14 10:03:01.766560 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:01.766535    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:01.769849 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:01.769824    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-8fd006-openshift-default-dockercfg-wmjb6\""
Sep 14 10:03:01.779594 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:01.779562    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"]
Sep 14 10:03:01.943772 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:01.943730    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-istio-data\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:01.943956 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:01.943802    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-workload-certs\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:01.943956 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:01.943851    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-istio-envoy\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:01.943956 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:01.943896    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54vcj\" (UniqueName: \"kubernetes.io/projected/07aeea07-f338-495e-8ee3-58672f77b10b-kube-api-access-54vcj\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:01.943956 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:01.943939    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-workload-socket\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:01.943956 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:01.943957    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07aeea07-f338-495e-8ee3-58672f77b10b-istio-podinfo\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:01.944201 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:01.944075    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07aeea07-f338-495e-8ee3-58672f77b10b-istiod-ca-cert\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:01.944201 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:01.944126    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-credential-socket\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:01.944269 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:01.944193    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07aeea07-f338-495e-8ee3-58672f77b10b-istio-token\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:02.045915 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.045806    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07aeea07-f338-495e-8ee3-58672f77b10b-istiod-ca-cert\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:02.045915 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.045858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-credential-socket\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:02.045915 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.045908    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07aeea07-f338-495e-8ee3-58672f77b10b-istio-token\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:02.046214 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.045960    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-istio-data\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:02.046214 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.045999    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-workload-certs\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:02.046214 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.046034    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-istio-envoy\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:02.046214 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.046073    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54vcj\" (UniqueName: \"kubernetes.io/projected/07aeea07-f338-495e-8ee3-58672f77b10b-kube-api-access-54vcj\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:02.046214 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.046122    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-workload-socket\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:02.046214 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.046149    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07aeea07-f338-495e-8ee3-58672f77b10b-istio-podinfo\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:02.046511 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.046483    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-workload-certs\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:02.046569 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.046503    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-istio-data\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:02.046569 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.046511    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-credential-socket\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:02.046704 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.046679    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07aeea07-f338-495e-8ee3-58672f77b10b-istiod-ca-cert\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:02.046790 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.046744    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-workload-socket\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:02.048646 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.048616    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-istio-envoy\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:02.048911 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.048888    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07aeea07-f338-495e-8ee3-58672f77b10b-istio-podinfo\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:02.054880 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.054851    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07aeea07-f338-495e-8ee3-58672f77b10b-istio-token\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:02.055240 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.055216    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54vcj\" (UniqueName: \"kubernetes.io/projected/07aeea07-f338-495e-8ee3-58672f77b10b-kube-api-access-54vcj\") pod \"e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") " pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:02.078855 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.078812    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:02.364780 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.364753    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"]
Sep 14 10:03:02.366466 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:03:02.366428    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07aeea07_f338_495e_8ee3_58672f77b10b.slice/crio-7f697281e406002a936327434d8a96483784ff55827ec21f0b6f9c27f3743325 WatchSource:0}: Error finding container 7f697281e406002a936327434d8a96483784ff55827ec21f0b6f9c27f3743325: Status 404 returned error can't find the container with id 7f697281e406002a936327434d8a96483784ff55827ec21f0b6f9c27f3743325
Sep 14 10:03:02.368938 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.368896    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 10:03:02.369033 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.368990    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 10:03:02.369073 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.369037    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 10:03:02.489625 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.489580    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54" event={"ID":"07aeea07-f338-495e-8ee3-58672f77b10b","Type":"ContainerStarted","Data":"56dd58fc9edc97f76307785da81823dce1e2e861d4ec22f3ca92787347d28070"}
Sep 14 10:03:02.489872 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.489657    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54" event={"ID":"07aeea07-f338-495e-8ee3-58672f77b10b","Type":"ContainerStarted","Data":"7f697281e406002a936327434d8a96483784ff55827ec21f0b6f9c27f3743325"}
Sep 14 10:03:02.514436 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:02.514360    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54" podStartSLOduration=1.514337531 podStartE2EDuration="1.514337531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:03:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:03:02.511027672 +0000 UTC m=+1198.369260052" watchObservedRunningTime="2026-09-14 10:03:02.514337531 +0000 UTC m=+1198.372569904"
Sep 14 10:03:03.079448 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:03.079408    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:03.084836 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:03.084806    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:03.495226 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:03.495177    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:03.496277 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:03.496246    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:08.779437 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:08.779402    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:03:34.536920 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:34.536863    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 14 10:03:34.537431 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:34.536938    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54" podUID="07aeea07-f338-495e-8ee3-58672f77b10b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 14 10:03:35.584137 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:35.584093    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:03:35.680490 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:35.680454    2581 generic.go:356] "Generic (PLEG): container finished" podID="07aeea07-f338-495e-8ee3-58672f77b10b" containerID="56dd58fc9edc97f76307785da81823dce1e2e861d4ec22f3ca92787347d28070" exitCode=0
Sep 14 10:03:35.680663 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:35.680515    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54" event={"ID":"07aeea07-f338-495e-8ee3-58672f77b10b","Type":"ContainerDied","Data":"56dd58fc9edc97f76307785da81823dce1e2e861d4ec22f3ca92787347d28070"}
Sep 14 10:03:35.681042 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:35.681024    2581 scope.go:117] "RemoveContainer" containerID="56dd58fc9edc97f76307785da81823dce1e2e861d4ec22f3ca92787347d28070"
Sep 14 10:03:35.682485 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:35.682444    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 10:03:35.682591 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:35.682525    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 10:03:35.682591 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:35.682563    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 10:03:36.688238 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:36.688205    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54" event={"ID":"07aeea07-f338-495e-8ee3-58672f77b10b","Type":"ContainerStarted","Data":"f74e7b70ec4502aaaf5a26386269da5dc7982f069e37267840939f8b81a7e6e1"}
Sep 14 10:03:37.079936 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:37.079845    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:37.080089 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:37.080055    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 14 10:03:37.080132 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:37.080097    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54" podUID="07aeea07-f338-495e-8ee3-58672f77b10b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 14 10:03:38.080162 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:38.080123    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 14 10:03:38.080559 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:38.080186    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54" podUID="07aeea07-f338-495e-8ee3-58672f77b10b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 14 10:03:39.079355 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:39.079316    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 14 10:03:39.079538 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:39.079381    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54" podUID="07aeea07-f338-495e-8ee3-58672f77b10b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 14 10:03:40.079819 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:40.079779    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 14 10:03:40.080248 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:40.079842    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54" podUID="07aeea07-f338-495e-8ee3-58672f77b10b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 14 10:03:41.079968 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:41.079930    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 14 10:03:41.080358 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:41.079989    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54" podUID="07aeea07-f338-495e-8ee3-58672f77b10b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 14 10:03:42.082979 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:42.082947    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:42.083433 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:42.083203    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:42.083899 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:42.083880    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:03:43.760634 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:43.760603    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"]
Sep 14 10:03:43.763288 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:43.763266    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"
Sep 14 10:03:43.766225 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:43.766186    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-9e19b7-serving-cert\""
Sep 14 10:03:43.782073 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:43.782034    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"]
Sep 14 10:03:43.794973 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:43.794939    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp\" (UID: \"f152aebe-c4c6-4b32-b72c-f0d96c3199b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"
Sep 14 10:03:43.795143 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:43.795104    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp\" (UID: \"f152aebe-c4c6-4b32-b72c-f0d96c3199b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"
Sep 14 10:03:43.795213 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:43.795182    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp\" (UID: \"f152aebe-c4c6-4b32-b72c-f0d96c3199b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"
Sep 14 10:03:43.795449 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:43.795422    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpjdg\" (UniqueName: \"kubernetes.io/projected/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-kube-api-access-cpjdg\") pod \"maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp\" (UID: \"f152aebe-c4c6-4b32-b72c-f0d96c3199b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"
Sep 14 10:03:43.896779 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:43.896739    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp\" (UID: \"f152aebe-c4c6-4b32-b72c-f0d96c3199b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"
Sep 14 10:03:43.896997 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:43.896824    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpjdg\" (UniqueName: \"kubernetes.io/projected/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-kube-api-access-cpjdg\") pod \"maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp\" (UID: \"f152aebe-c4c6-4b32-b72c-f0d96c3199b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"
Sep 14 10:03:43.896997 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:43.896861    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp\" (UID: \"f152aebe-c4c6-4b32-b72c-f0d96c3199b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"
Sep 14 10:03:43.896997 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:03:43.896891    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-serving-cert: secret "maas-api-e2e-shared-b-w2-9e19b7-serving-cert" not found
Sep 14 10:03:43.896997 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:43.896948    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp\" (UID: \"f152aebe-c4c6-4b32-b72c-f0d96c3199b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"
Sep 14 10:03:43.896997 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:03:43.896995    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-maas-api-tls podName:f152aebe-c4c6-4b32-b72c-f0d96c3199b0 nodeName:}" failed. No retries permitted until 2026-09-14 10:03:44.396971194 +0000 UTC m=+1240.255203536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-maas-api-tls") pod "maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp" (UID: "f152aebe-c4c6-4b32-b72c-f0d96c3199b0") : secret "maas-api-e2e-shared-b-w2-9e19b7-serving-cert" not found
Sep 14 10:03:43.897660 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:43.897637    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp\" (UID: \"f152aebe-c4c6-4b32-b72c-f0d96c3199b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"
Sep 14 10:03:43.899536 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:43.899512    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp\" (UID: \"f152aebe-c4c6-4b32-b72c-f0d96c3199b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"
Sep 14 10:03:43.905788 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:43.905762    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpjdg\" (UniqueName: \"kubernetes.io/projected/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-kube-api-access-cpjdg\") pod \"maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp\" (UID: \"f152aebe-c4c6-4b32-b72c-f0d96c3199b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"
Sep 14 10:03:44.403903 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:44.403855    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp\" (UID: \"f152aebe-c4c6-4b32-b72c-f0d96c3199b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"
Sep 14 10:03:44.407034 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:44.406998    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp\" (UID: \"f152aebe-c4c6-4b32-b72c-f0d96c3199b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"
Sep 14 10:03:44.674934 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:44.674833    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"
Sep 14 10:03:44.956887 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:44.956853    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"]
Sep 14 10:03:44.958310 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:03:44.958279    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf152aebe_c4c6_4b32_b72c_f0d96c3199b0.slice/crio-b0b61c8e8eef4987422c633c386b525cb6efde23e5c4e9b2077fedfc0d7c0654 WatchSource:0}: Error finding container b0b61c8e8eef4987422c633c386b525cb6efde23e5c4e9b2077fedfc0d7c0654: Status 404 returned error can't find the container with id b0b61c8e8eef4987422c633c386b525cb6efde23e5c4e9b2077fedfc0d7c0654
Sep 14 10:03:45.770182 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:45.770147    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp" event={"ID":"f152aebe-c4c6-4b32-b72c-f0d96c3199b0","Type":"ContainerStarted","Data":"ea1c1a3507bc56609f610b5f865bbb5f7cf5e41246515a19555e1cf749727d31"}
Sep 14 10:03:45.770370 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:45.770203    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp" event={"ID":"f152aebe-c4c6-4b32-b72c-f0d96c3199b0","Type":"ContainerStarted","Data":"b0b61c8e8eef4987422c633c386b525cb6efde23e5c4e9b2077fedfc0d7c0654"}
Sep 14 10:03:45.770370 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:45.770235    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"
Sep 14 10:03:45.791958 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:45.791897    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp" podStartSLOduration=2.396188252 podStartE2EDuration="2.791879647s" totalImagesPullingTime="395.691395ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:03:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:03:45.78916232 +0000 UTC m=+1241.647394668" watchObservedRunningTime="2026-09-14 10:03:45.791879647 +0000 UTC m=+1241.650112002"
Sep 14 10:03:51.781847 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:51.781813    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"
Sep 14 10:03:54.559658 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.559621    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"]
Sep 14 10:03:54.562299 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.562277    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:03:54.568311 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.568286    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-938944\"/\"kube-root-ca.crt\""
Sep 14 10:03:54.569617 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.569594    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-938944\"/\"default-dockercfg-89qsc\""
Sep 14 10:03:54.569723 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.569595    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-938944\"/\"openshift-service-ca.crt\""
Sep 14 10:03:54.569723 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.569679    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-938944\"/\"noten-model-938944-kserve-self-signed-certs\""
Sep 14 10:03:54.597575 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.597537    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"]
Sep 14 10:03:54.716216 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.716177    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-model-cache\") pod \"noten-model-938944-kserve-bb785d7d7-tcn2h\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") " pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:03:54.716392 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.716230    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp68g\" (UniqueName: \"kubernetes.io/projected/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-kube-api-access-bp68g\") pod \"noten-model-938944-kserve-bb785d7d7-tcn2h\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") " pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:03:54.716392 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.716328    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-dshm\") pod \"noten-model-938944-kserve-bb785d7d7-tcn2h\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") " pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:03:54.716473 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.716385    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-home\") pod \"noten-model-938944-kserve-bb785d7d7-tcn2h\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") " pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:03:54.716473 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.716422    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-tls-certs\") pod \"noten-model-938944-kserve-bb785d7d7-tcn2h\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") " pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:03:54.716539 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.716484    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-tmp-dir\") pod \"noten-model-938944-kserve-bb785d7d7-tcn2h\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") " pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:03:54.817984 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.817892    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp68g\" (UniqueName: \"kubernetes.io/projected/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-kube-api-access-bp68g\") pod \"noten-model-938944-kserve-bb785d7d7-tcn2h\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") " pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:03:54.818164 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.818066    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-dshm\") pod \"noten-model-938944-kserve-bb785d7d7-tcn2h\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") " pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:03:54.818164 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.818121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-home\") pod \"noten-model-938944-kserve-bb785d7d7-tcn2h\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") " pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:03:54.818164 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.818148    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-tls-certs\") pod \"noten-model-938944-kserve-bb785d7d7-tcn2h\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") " pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:03:54.818337 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.818255    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-tmp-dir\") pod \"noten-model-938944-kserve-bb785d7d7-tcn2h\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") " pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:03:54.818337 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.818286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-model-cache\") pod \"noten-model-938944-kserve-bb785d7d7-tcn2h\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") " pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:03:54.818607 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.818584    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-home\") pod \"noten-model-938944-kserve-bb785d7d7-tcn2h\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") " pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:03:54.818778 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.818754    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-model-cache\") pod \"noten-model-938944-kserve-bb785d7d7-tcn2h\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") " pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:03:54.818960 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.818933    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-tmp-dir\") pod \"noten-model-938944-kserve-bb785d7d7-tcn2h\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") " pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:03:54.820779 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.820754    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-dshm\") pod \"noten-model-938944-kserve-bb785d7d7-tcn2h\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") " pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:03:54.821474 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.821444    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-tls-certs\") pod \"noten-model-938944-kserve-bb785d7d7-tcn2h\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") " pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:03:54.831927 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.831895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp68g\" (UniqueName: \"kubernetes.io/projected/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-kube-api-access-bp68g\") pod \"noten-model-938944-kserve-bb785d7d7-tcn2h\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") " pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:03:54.872075 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:54.872036    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:03:55.148999 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:55.148971    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"]
Sep 14 10:03:55.150261 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:03:55.150225    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a2e071e_d5e8_4f2f_bc82_42c28a940a19.slice/crio-df4e01037429c85429caacebb373ce025c255ba02ea37eb6dea491264eec40cb WatchSource:0}: Error finding container df4e01037429c85429caacebb373ce025c255ba02ea37eb6dea491264eec40cb: Status 404 returned error can't find the container with id df4e01037429c85429caacebb373ce025c255ba02ea37eb6dea491264eec40cb
Sep 14 10:03:55.829026 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:55.828991    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h" event={"ID":"6a2e071e-d5e8-4f2f-bc82-42c28a940a19","Type":"ContainerStarted","Data":"067bfac855504f549e95b79ad91174b0d4ce4ff4369a80d7b465f6c4e2dc8bac"}
Sep 14 10:03:55.829026 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:55.829033    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h" event={"ID":"6a2e071e-d5e8-4f2f-bc82-42c28a940a19","Type":"ContainerStarted","Data":"df4e01037429c85429caacebb373ce025c255ba02ea37eb6dea491264eec40cb"}
Sep 14 10:03:55.854799 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:55.854741    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h" podStartSLOduration=1.854723551 podStartE2EDuration="1.854723551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:03:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:03:55.854537082 +0000 UTC m=+1251.712769466" watchObservedRunningTime="2026-09-14 10:03:55.854723551 +0000 UTC m=+1251.712955900"
Sep 14 10:03:58.311883 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:03:58.311805    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:04:04.872892 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:04.872853    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:04:04.873452 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:04.872908    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:04:04.885904 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:04.885869    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:04:05.902501 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:05.902468    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:04:13.657189 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:13.657156    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"]
Sep 14 10:04:13.781308 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:13.781268    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"]
Sep 14 10:04:13.781598 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:13.781547    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk" podUID="7ee56093-1d28-4722-8222-ef5a305b5db5" containerName="istio-proxy" containerID="cri-o://86c30cc10bcb767e62b3670bbaba7c864e99d71efe02275c39c0b589b29519ee" gracePeriod=30
Sep 14 10:04:14.715278 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:14.715241    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"]
Sep 14 10:04:18.966437 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:18.966223    2581 generic.go:356] "Generic (PLEG): container finished" podID="7ee56093-1d28-4722-8222-ef5a305b5db5" containerID="86c30cc10bcb767e62b3670bbaba7c864e99d71efe02275c39c0b589b29519ee" exitCode=0
Sep 14 10:04:18.966437 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:18.966353    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk" event={"ID":"7ee56093-1d28-4722-8222-ef5a305b5db5","Type":"ContainerDied","Data":"86c30cc10bcb767e62b3670bbaba7c864e99d71efe02275c39c0b589b29519ee"}
Sep 14 10:04:19.040814 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.040789    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:04:19.190247 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.190215    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-credential-socket\") pod \"7ee56093-1d28-4722-8222-ef5a305b5db5\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") "
Sep 14 10:04:19.190443 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.190303    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-podinfo\") pod \"7ee56093-1d28-4722-8222-ef5a305b5db5\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") "
Sep 14 10:04:19.190443 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.190337    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-workload-certs\") pod \"7ee56093-1d28-4722-8222-ef5a305b5db5\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") "
Sep 14 10:04:19.190443 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.190374    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-token\") pod \"7ee56093-1d28-4722-8222-ef5a305b5db5\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") "
Sep 14 10:04:19.190443 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.190425    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ee56093-1d28-4722-8222-ef5a305b5db5-istiod-ca-cert\") pod \"7ee56093-1d28-4722-8222-ef5a305b5db5\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") "
Sep 14 10:04:19.190660 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.190506    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-data\") pod \"7ee56093-1d28-4722-8222-ef5a305b5db5\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") "
Sep 14 10:04:19.190660 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.190520    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7ee56093-1d28-4722-8222-ef5a305b5db5" (UID: "7ee56093-1d28-4722-8222-ef5a305b5db5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:04:19.190660 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.190545    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-workload-socket\") pod \"7ee56093-1d28-4722-8222-ef5a305b5db5\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") "
Sep 14 10:04:19.190660 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.190631    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-envoy\") pod \"7ee56093-1d28-4722-8222-ef5a305b5db5\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") "
Sep 14 10:04:19.190891 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.190650    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7ee56093-1d28-4722-8222-ef5a305b5db5" (UID: "7ee56093-1d28-4722-8222-ef5a305b5db5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:04:19.190891 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.190661    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdczx\" (UniqueName: \"kubernetes.io/projected/7ee56093-1d28-4722-8222-ef5a305b5db5-kube-api-access-kdczx\") pod \"7ee56093-1d28-4722-8222-ef5a305b5db5\" (UID: \"7ee56093-1d28-4722-8222-ef5a305b5db5\") "
Sep 14 10:04:19.190891 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.190782    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-data" (OuterVolumeSpecName: "istio-data") pod "7ee56093-1d28-4722-8222-ef5a305b5db5" (UID: "7ee56093-1d28-4722-8222-ef5a305b5db5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:04:19.190891 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.190817    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ee56093-1d28-4722-8222-ef5a305b5db5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7ee56093-1d28-4722-8222-ef5a305b5db5" (UID: "7ee56093-1d28-4722-8222-ef5a305b5db5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:04:19.191148 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.191127    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-credential-socket\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:19.191237 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.191159    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-workload-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:19.191237 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.191175    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ee56093-1d28-4722-8222-ef5a305b5db5-istiod-ca-cert\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:19.191237 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.191183    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-data\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:19.191237 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.191128    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7ee56093-1d28-4722-8222-ef5a305b5db5" (UID: "7ee56093-1d28-4722-8222-ef5a305b5db5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:04:19.193275 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.193248    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-token" (OuterVolumeSpecName: "istio-token") pod "7ee56093-1d28-4722-8222-ef5a305b5db5" (UID: "7ee56093-1d28-4722-8222-ef5a305b5db5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:04:19.193505 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.193271    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7ee56093-1d28-4722-8222-ef5a305b5db5" (UID: "7ee56093-1d28-4722-8222-ef5a305b5db5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 10:04:19.193505 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.193339    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7ee56093-1d28-4722-8222-ef5a305b5db5" (UID: "7ee56093-1d28-4722-8222-ef5a305b5db5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:04:19.193505 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.193365    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ee56093-1d28-4722-8222-ef5a305b5db5-kube-api-access-kdczx" (OuterVolumeSpecName: "kube-api-access-kdczx") pod "7ee56093-1d28-4722-8222-ef5a305b5db5" (UID: "7ee56093-1d28-4722-8222-ef5a305b5db5"). InnerVolumeSpecName "kube-api-access-kdczx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:04:19.291783 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.291702    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-token\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:19.291783 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.291772    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-workload-socket\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:19.291783 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.291786    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-envoy\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:19.292033 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.291798    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdczx\" (UniqueName: \"kubernetes.io/projected/7ee56093-1d28-4722-8222-ef5a305b5db5-kube-api-access-kdczx\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:19.292033 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.291810    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ee56093-1d28-4722-8222-ef5a305b5db5-istio-podinfo\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:19.973072 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.973038    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk" event={"ID":"7ee56093-1d28-4722-8222-ef5a305b5db5","Type":"ContainerDied","Data":"3c675fea13a56e0afc60c29c65a469ef883791903edaf292a34461763cda1b30"}
Sep 14 10:04:19.973496 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.973096    2581 scope.go:117] "RemoveContainer" containerID="86c30cc10bcb767e62b3670bbaba7c864e99d71efe02275c39c0b589b29519ee"
Sep 14 10:04:19.973496 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.973048    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"
Sep 14 10:04:19.999615 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:19.999585    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"]
Sep 14 10:04:20.002787 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:20.002758    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-938944-openshift-default-68c4d79d66-cvrlk"]
Sep 14 10:04:20.657185 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:20.657147    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ee56093-1d28-4722-8222-ef5a305b5db5" path="/var/lib/kubelet/pods/7ee56093-1d28-4722-8222-ef5a305b5db5/volumes"
Sep 14 10:04:22.387974 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:22.387932    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:04:28.676912 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:28.676844    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h" podUID="6a2e071e-d5e8-4f2f-bc82-42c28a940a19" containerName="main" containerID="cri-o://067bfac855504f549e95b79ad91174b0d4ce4ff4369a80d7b465f6c4e2dc8bac" gracePeriod=45
Sep 14 10:04:28.941296 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:28.941267    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:04:29.022487 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.022453    2581 generic.go:356] "Generic (PLEG): container finished" podID="6a2e071e-d5e8-4f2f-bc82-42c28a940a19" containerID="067bfac855504f549e95b79ad91174b0d4ce4ff4369a80d7b465f6c4e2dc8bac" exitCode=0
Sep 14 10:04:29.022663 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.022496    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"
Sep 14 10:04:29.022663 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.022542    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h" event={"ID":"6a2e071e-d5e8-4f2f-bc82-42c28a940a19","Type":"ContainerDied","Data":"067bfac855504f549e95b79ad91174b0d4ce4ff4369a80d7b465f6c4e2dc8bac"}
Sep 14 10:04:29.022663 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.022584    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h" event={"ID":"6a2e071e-d5e8-4f2f-bc82-42c28a940a19","Type":"ContainerDied","Data":"df4e01037429c85429caacebb373ce025c255ba02ea37eb6dea491264eec40cb"}
Sep 14 10:04:29.022663 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.022602    2581 scope.go:117] "RemoveContainer" containerID="067bfac855504f549e95b79ad91174b0d4ce4ff4369a80d7b465f6c4e2dc8bac"
Sep 14 10:04:29.034166 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.034143    2581 scope.go:117] "RemoveContainer" containerID="067bfac855504f549e95b79ad91174b0d4ce4ff4369a80d7b465f6c4e2dc8bac"
Sep 14 10:04:29.034493 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:04:29.034465    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"067bfac855504f549e95b79ad91174b0d4ce4ff4369a80d7b465f6c4e2dc8bac\": container with ID starting with 067bfac855504f549e95b79ad91174b0d4ce4ff4369a80d7b465f6c4e2dc8bac not found: ID does not exist" containerID="067bfac855504f549e95b79ad91174b0d4ce4ff4369a80d7b465f6c4e2dc8bac"
Sep 14 10:04:29.034567 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.034507    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"067bfac855504f549e95b79ad91174b0d4ce4ff4369a80d7b465f6c4e2dc8bac"} err="failed to get container status \"067bfac855504f549e95b79ad91174b0d4ce4ff4369a80d7b465f6c4e2dc8bac\": rpc error: code = NotFound desc = could not find container \"067bfac855504f549e95b79ad91174b0d4ce4ff4369a80d7b465f6c4e2dc8bac\": container with ID starting with 067bfac855504f549e95b79ad91174b0d4ce4ff4369a80d7b465f6c4e2dc8bac not found: ID does not exist"
Sep 14 10:04:29.106052 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.106020    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-dshm\") pod \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") "
Sep 14 10:04:29.106214 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.106128    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-tls-certs\") pod \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") "
Sep 14 10:04:29.106214 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.106176    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp68g\" (UniqueName: \"kubernetes.io/projected/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-kube-api-access-bp68g\") pod \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") "
Sep 14 10:04:29.106293 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.106244    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-model-cache\") pod \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") "
Sep 14 10:04:29.106293 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.106272    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-home\") pod \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") "
Sep 14 10:04:29.106366 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.106321    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-tmp-dir\") pod \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\" (UID: \"6a2e071e-d5e8-4f2f-bc82-42c28a940a19\") "
Sep 14 10:04:29.106649 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.106541    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-model-cache" (OuterVolumeSpecName: "model-cache") pod "6a2e071e-d5e8-4f2f-bc82-42c28a940a19" (UID: "6a2e071e-d5e8-4f2f-bc82-42c28a940a19"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:04:29.106649 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.106587    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-home" (OuterVolumeSpecName: "home") pod "6a2e071e-d5e8-4f2f-bc82-42c28a940a19" (UID: "6a2e071e-d5e8-4f2f-bc82-42c28a940a19"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:04:29.106649 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.106618    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6a2e071e-d5e8-4f2f-bc82-42c28a940a19" (UID: "6a2e071e-d5e8-4f2f-bc82-42c28a940a19"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:04:29.106887 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.106765    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-model-cache\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:29.106887 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.106784    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-home\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:29.106887 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.106797    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-tmp-dir\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:29.108403 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.108377    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-dshm" (OuterVolumeSpecName: "dshm") pod "6a2e071e-d5e8-4f2f-bc82-42c28a940a19" (UID: "6a2e071e-d5e8-4f2f-bc82-42c28a940a19"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:04:29.108480 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.108448    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6a2e071e-d5e8-4f2f-bc82-42c28a940a19" (UID: "6a2e071e-d5e8-4f2f-bc82-42c28a940a19"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:04:29.108480 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.108467    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-kube-api-access-bp68g" (OuterVolumeSpecName: "kube-api-access-bp68g") pod "6a2e071e-d5e8-4f2f-bc82-42c28a940a19" (UID: "6a2e071e-d5e8-4f2f-bc82-42c28a940a19"). InnerVolumeSpecName "kube-api-access-bp68g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:04:29.207614 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.207526    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-dshm\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:29.207614 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.207557    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-tls-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:29.207614 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.207568    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp68g\" (UniqueName: \"kubernetes.io/projected/6a2e071e-d5e8-4f2f-bc82-42c28a940a19-kube-api-access-bp68g\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:29.346055 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.346020    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"]
Sep 14 10:04:29.351053 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.351022    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-938944/noten-model-938944-kserve-bb785d7d7-tcn2h"]
Sep 14 10:04:29.736051 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.735959    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l" podUID="31916249-ef6f-4246-bf6f-907cc0ebc649" containerName="main" containerID="cri-o://24acfabb601cfc327f4bf73516e0f4ff07e7de224ce725e82084a090aa848b93" gracePeriod=45
Sep 14 10:04:29.998018 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:29.997944    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:04:30.029118 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.029086    2581 generic.go:356] "Generic (PLEG): container finished" podID="31916249-ef6f-4246-bf6f-907cc0ebc649" containerID="24acfabb601cfc327f4bf73516e0f4ff07e7de224ce725e82084a090aa848b93" exitCode=0
Sep 14 10:04:30.029275 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.029134    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"
Sep 14 10:04:30.029275 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.029153    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l" event={"ID":"31916249-ef6f-4246-bf6f-907cc0ebc649","Type":"ContainerDied","Data":"24acfabb601cfc327f4bf73516e0f4ff07e7de224ce725e82084a090aa848b93"}
Sep 14 10:04:30.029275 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.029200    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l" event={"ID":"31916249-ef6f-4246-bf6f-907cc0ebc649","Type":"ContainerDied","Data":"98524b308019e4f548397a5782027dcdf723bc59ea425fd54576c86ccebfd687"}
Sep 14 10:04:30.029275 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.029234    2581 scope.go:117] "RemoveContainer" containerID="24acfabb601cfc327f4bf73516e0f4ff07e7de224ce725e82084a090aa848b93"
Sep 14 10:04:30.039088 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.039064    2581 scope.go:117] "RemoveContainer" containerID="24acfabb601cfc327f4bf73516e0f4ff07e7de224ce725e82084a090aa848b93"
Sep 14 10:04:30.039460 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:04:30.039435    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24acfabb601cfc327f4bf73516e0f4ff07e7de224ce725e82084a090aa848b93\": container with ID starting with 24acfabb601cfc327f4bf73516e0f4ff07e7de224ce725e82084a090aa848b93 not found: ID does not exist" containerID="24acfabb601cfc327f4bf73516e0f4ff07e7de224ce725e82084a090aa848b93"
Sep 14 10:04:30.039523 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.039472    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24acfabb601cfc327f4bf73516e0f4ff07e7de224ce725e82084a090aa848b93"} err="failed to get container status \"24acfabb601cfc327f4bf73516e0f4ff07e7de224ce725e82084a090aa848b93\": rpc error: code = NotFound desc = could not find container \"24acfabb601cfc327f4bf73516e0f4ff07e7de224ce725e82084a090aa848b93\": container with ID starting with 24acfabb601cfc327f4bf73516e0f4ff07e7de224ce725e82084a090aa848b93 not found: ID does not exist"
Sep 14 10:04:30.115769 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.115732    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-home\") pod \"31916249-ef6f-4246-bf6f-907cc0ebc649\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") "
Sep 14 10:04:30.115960 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.115821    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-model-cache\") pod \"31916249-ef6f-4246-bf6f-907cc0ebc649\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") "
Sep 14 10:04:30.115960 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.115874    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpzjp\" (UniqueName: \"kubernetes.io/projected/31916249-ef6f-4246-bf6f-907cc0ebc649-kube-api-access-lpzjp\") pod \"31916249-ef6f-4246-bf6f-907cc0ebc649\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") "
Sep 14 10:04:30.115960 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.115929    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-tmp-dir\") pod \"31916249-ef6f-4246-bf6f-907cc0ebc649\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") "
Sep 14 10:04:30.116138 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.115986    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-dshm\") pod \"31916249-ef6f-4246-bf6f-907cc0ebc649\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") "
Sep 14 10:04:30.116138 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.116023    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31916249-ef6f-4246-bf6f-907cc0ebc649-tls-certs\") pod \"31916249-ef6f-4246-bf6f-907cc0ebc649\" (UID: \"31916249-ef6f-4246-bf6f-907cc0ebc649\") "
Sep 14 10:04:30.116138 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.116050    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-home" (OuterVolumeSpecName: "home") pod "31916249-ef6f-4246-bf6f-907cc0ebc649" (UID: "31916249-ef6f-4246-bf6f-907cc0ebc649"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:04:30.116281 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.116126    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-model-cache" (OuterVolumeSpecName: "model-cache") pod "31916249-ef6f-4246-bf6f-907cc0ebc649" (UID: "31916249-ef6f-4246-bf6f-907cc0ebc649"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:04:30.116281 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.116244    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "31916249-ef6f-4246-bf6f-907cc0ebc649" (UID: "31916249-ef6f-4246-bf6f-907cc0ebc649"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:04:30.116415 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.116397    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-home\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:30.116469 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.116413    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-model-cache\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:30.116469 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.116428    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-tmp-dir\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:30.118370 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.118345    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31916249-ef6f-4246-bf6f-907cc0ebc649-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "31916249-ef6f-4246-bf6f-907cc0ebc649" (UID: "31916249-ef6f-4246-bf6f-907cc0ebc649"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:04:30.118370 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.118341    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31916249-ef6f-4246-bf6f-907cc0ebc649-kube-api-access-lpzjp" (OuterVolumeSpecName: "kube-api-access-lpzjp") pod "31916249-ef6f-4246-bf6f-907cc0ebc649" (UID: "31916249-ef6f-4246-bf6f-907cc0ebc649"). InnerVolumeSpecName "kube-api-access-lpzjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:04:30.118370 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.118349    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-dshm" (OuterVolumeSpecName: "dshm") pod "31916249-ef6f-4246-bf6f-907cc0ebc649" (UID: "31916249-ef6f-4246-bf6f-907cc0ebc649"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:04:30.217177 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.217137    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31916249-ef6f-4246-bf6f-907cc0ebc649-dshm\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:30.217177 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.217169    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31916249-ef6f-4246-bf6f-907cc0ebc649-tls-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:30.217177 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.217183    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpzjp\" (UniqueName: \"kubernetes.io/projected/31916249-ef6f-4246-bf6f-907cc0ebc649-kube-api-access-lpzjp\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:30.362399 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.362361    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"]
Sep 14 10:04:30.362741 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.362696    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-2901ec/e2e-conflict-a-c109e646-kserve-5bf5dbcf8c-fc68l"]
Sep 14 10:04:30.656184 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.656096    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31916249-ef6f-4246-bf6f-907cc0ebc649" path="/var/lib/kubelet/pods/31916249-ef6f-4246-bf6f-907cc0ebc649/volumes"
Sep 14 10:04:30.656526 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:30.656512    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a2e071e-d5e8-4f2f-bc82-42c28a940a19" path="/var/lib/kubelet/pods/6a2e071e-d5e8-4f2f-bc82-42c28a940a19/volumes"
Sep 14 10:04:31.812229 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.812189    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq"]
Sep 14 10:04:31.812645 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.812627    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a2e071e-d5e8-4f2f-bc82-42c28a940a19" containerName="main"
Sep 14 10:04:31.812699 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.812645    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a2e071e-d5e8-4f2f-bc82-42c28a940a19" containerName="main"
Sep 14 10:04:31.812699 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.812685    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ee56093-1d28-4722-8222-ef5a305b5db5" containerName="istio-proxy"
Sep 14 10:04:31.812699 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.812695    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ee56093-1d28-4722-8222-ef5a305b5db5" containerName="istio-proxy"
Sep 14 10:04:31.812930 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.812725    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31916249-ef6f-4246-bf6f-907cc0ebc649" containerName="main"
Sep 14 10:04:31.812930 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.812733    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="31916249-ef6f-4246-bf6f-907cc0ebc649" containerName="main"
Sep 14 10:04:31.812930 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.812838    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a2e071e-d5e8-4f2f-bc82-42c28a940a19" containerName="main"
Sep 14 10:04:31.812930 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.812858    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ee56093-1d28-4722-8222-ef5a305b5db5" containerName="istio-proxy"
Sep 14 10:04:31.812930 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.812869    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="31916249-ef6f-4246-bf6f-907cc0ebc649" containerName="main"
Sep 14 10:04:31.815807 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.815788    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq"
Sep 14 10:04:31.818781 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.818756    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-75017ebc-dockercfg-7hpqd\""
Sep 14 10:04:31.818781 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.818774    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-75017ebc\""
Sep 14 10:04:31.830201 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.830171    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq"]
Sep 14 10:04:31.833107 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.833072    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6098be5-3509-46ff-b010-7fa74e312adf-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq\" (UID: \"f6098be5-3509-46ff-b010-7fa74e312adf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq"
Sep 14 10:04:31.833230 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.833194    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smpxc\" (UniqueName: \"kubernetes.io/projected/f6098be5-3509-46ff-b010-7fa74e312adf-kube-api-access-smpxc\") pod \"payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq\" (UID: \"f6098be5-3509-46ff-b010-7fa74e312adf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq"
Sep 14 10:04:31.837723 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.837684    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2"]
Sep 14 10:04:31.840277 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.840260    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2"
Sep 14 10:04:31.858493 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.858464    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2"]
Sep 14 10:04:31.934522 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.934483    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smpxc\" (UniqueName: \"kubernetes.io/projected/f6098be5-3509-46ff-b010-7fa74e312adf-kube-api-access-smpxc\") pod \"payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq\" (UID: \"f6098be5-3509-46ff-b010-7fa74e312adf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq"
Sep 14 10:04:31.934740 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.934692    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88954f40-46e0-4de1-9844-9b5f14115ae3-plugins-config-volume\") pod \"payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2\" (UID: \"88954f40-46e0-4de1-9844-9b5f14115ae3\") " pod="openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2"
Sep 14 10:04:31.934877 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.934855    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6098be5-3509-46ff-b010-7fa74e312adf-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq\" (UID: \"f6098be5-3509-46ff-b010-7fa74e312adf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq"
Sep 14 10:04:31.934949 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.934918    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm6mq\" (UniqueName: \"kubernetes.io/projected/88954f40-46e0-4de1-9844-9b5f14115ae3-kube-api-access-qm6mq\") pod \"payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2\" (UID: \"88954f40-46e0-4de1-9844-9b5f14115ae3\") " pod="openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2"
Sep 14 10:04:31.936073 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.936018    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6098be5-3509-46ff-b010-7fa74e312adf-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq\" (UID: \"f6098be5-3509-46ff-b010-7fa74e312adf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq"
Sep 14 10:04:31.944628 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:31.944595    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smpxc\" (UniqueName: \"kubernetes.io/projected/f6098be5-3509-46ff-b010-7fa74e312adf-kube-api-access-smpxc\") pod \"payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq\" (UID: \"f6098be5-3509-46ff-b010-7fa74e312adf\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq"
Sep 14 10:04:32.036127 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:32.036078    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88954f40-46e0-4de1-9844-9b5f14115ae3-plugins-config-volume\") pod \"payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2\" (UID: \"88954f40-46e0-4de1-9844-9b5f14115ae3\") " pod="openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2"
Sep 14 10:04:32.036330 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:32.036196    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm6mq\" (UniqueName: \"kubernetes.io/projected/88954f40-46e0-4de1-9844-9b5f14115ae3-kube-api-access-qm6mq\") pod \"payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2\" (UID: \"88954f40-46e0-4de1-9844-9b5f14115ae3\") " pod="openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2"
Sep 14 10:04:32.036868 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:32.036836    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88954f40-46e0-4de1-9844-9b5f14115ae3-plugins-config-volume\") pod \"payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2\" (UID: \"88954f40-46e0-4de1-9844-9b5f14115ae3\") " pod="openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2"
Sep 14 10:04:32.045505 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:32.045473    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm6mq\" (UniqueName: \"kubernetes.io/projected/88954f40-46e0-4de1-9844-9b5f14115ae3-kube-api-access-qm6mq\") pod \"payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2\" (UID: \"88954f40-46e0-4de1-9844-9b5f14115ae3\") " pod="openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2"
Sep 14 10:04:32.126852 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:32.126701    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq"
Sep 14 10:04:32.151467 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:32.151435    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2"
Sep 14 10:04:32.408777 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:32.408738    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq"]
Sep 14 10:04:32.408924 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:04:32.408902    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6098be5_3509_46ff_b010_7fa74e312adf.slice/crio-726a320170a0565273b7c948bdb4d348454c5b467eaee876030bb444e2efd16c WatchSource:0}: Error finding container 726a320170a0565273b7c948bdb4d348454c5b467eaee876030bb444e2efd16c: Status 404 returned error can't find the container with id 726a320170a0565273b7c948bdb4d348454c5b467eaee876030bb444e2efd16c
Sep 14 10:04:32.455941 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:32.455912    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2"]
Sep 14 10:04:32.457641 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:04:32.457615    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88954f40_46e0_4de1_9844_9b5f14115ae3.slice/crio-835d1a91c3ba660e415684d656dc62ef7fd73be9295e89085686200d59f6d1b1 WatchSource:0}: Error finding container 835d1a91c3ba660e415684d656dc62ef7fd73be9295e89085686200d59f6d1b1: Status 404 returned error can't find the container with id 835d1a91c3ba660e415684d656dc62ef7fd73be9295e89085686200d59f6d1b1
Sep 14 10:04:33.049246 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:33.049210    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq" event={"ID":"f6098be5-3509-46ff-b010-7fa74e312adf","Type":"ContainerStarted","Data":"23c09a0330e7912c1586783c4fd9dfcd32bc4de36a3b14a016b8928f6cb99821"}
Sep 14 10:04:33.049723 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:33.049267    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq" event={"ID":"f6098be5-3509-46ff-b010-7fa74e312adf","Type":"ContainerStarted","Data":"726a320170a0565273b7c948bdb4d348454c5b467eaee876030bb444e2efd16c"}
Sep 14 10:04:33.049723 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:33.049309    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq"
Sep 14 10:04:33.051076 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:33.051052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2" event={"ID":"88954f40-46e0-4de1-9844-9b5f14115ae3","Type":"ContainerStarted","Data":"2495e63c8d259f0ca6106eed3fc3cc400f191d35f775c5c047e0aa28cf3aae3c"}
Sep 14 10:04:33.051183 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:33.051095    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2" event={"ID":"88954f40-46e0-4de1-9844-9b5f14115ae3","Type":"ContainerStarted","Data":"835d1a91c3ba660e415684d656dc62ef7fd73be9295e89085686200d59f6d1b1"}
Sep 14 10:04:33.051183 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:33.051137    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2"
Sep 14 10:04:33.073485 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:33.073423    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq" podStartSLOduration=2.073406334 podStartE2EDuration="2.073406334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:04:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:04:33.070194877 +0000 UTC m=+1288.928427233" watchObservedRunningTime="2026-09-14 10:04:33.073406334 +0000 UTC m=+1288.931638689"
Sep 14 10:04:33.089935 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:33.089882    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2" podStartSLOduration=2.089865228 podStartE2EDuration="2.089865228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:04:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:04:33.089519963 +0000 UTC m=+1288.947752318" watchObservedRunningTime="2026-09-14 10:04:33.089865228 +0000 UTC m=+1288.948097583"
Sep 14 10:04:35.663384 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:35.663346    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr"]
Sep 14 10:04:35.663929 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:35.663652    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr" podUID="34e9540a-d439-448d-a87e-356ea78e682d" containerName="payload-pre-processing" containerID="cri-o://a934db4a6cdd56b6bd447a00384ebd15798dc4e4268cd19d19528b25fd8bb3dc" gracePeriod=30
Sep 14 10:04:35.935041 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:35.935014    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr"
Sep 14 10:04:35.977730 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:35.977684    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pb6sh\" (UniqueName: \"kubernetes.io/projected/34e9540a-d439-448d-a87e-356ea78e682d-kube-api-access-pb6sh\") pod \"34e9540a-d439-448d-a87e-356ea78e682d\" (UID: \"34e9540a-d439-448d-a87e-356ea78e682d\") "
Sep 14 10:04:35.977937 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:35.977794    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34e9540a-d439-448d-a87e-356ea78e682d-plugins-config-volume\") pod \"34e9540a-d439-448d-a87e-356ea78e682d\" (UID: \"34e9540a-d439-448d-a87e-356ea78e682d\") "
Sep 14 10:04:35.978168 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:35.978142    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34e9540a-d439-448d-a87e-356ea78e682d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "34e9540a-d439-448d-a87e-356ea78e682d" (UID: "34e9540a-d439-448d-a87e-356ea78e682d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:04:35.980066 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:35.980035    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34e9540a-d439-448d-a87e-356ea78e682d-kube-api-access-pb6sh" (OuterVolumeSpecName: "kube-api-access-pb6sh") pod "34e9540a-d439-448d-a87e-356ea78e682d" (UID: "34e9540a-d439-448d-a87e-356ea78e682d"). InnerVolumeSpecName "kube-api-access-pb6sh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:04:36.069339 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:36.069296    2581 generic.go:356] "Generic (PLEG): container finished" podID="34e9540a-d439-448d-a87e-356ea78e682d" containerID="a934db4a6cdd56b6bd447a00384ebd15798dc4e4268cd19d19528b25fd8bb3dc" exitCode=0
Sep 14 10:04:36.069339 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:36.069340    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr"
Sep 14 10:04:36.069570 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:36.069379    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr" event={"ID":"34e9540a-d439-448d-a87e-356ea78e682d","Type":"ContainerDied","Data":"a934db4a6cdd56b6bd447a00384ebd15798dc4e4268cd19d19528b25fd8bb3dc"}
Sep 14 10:04:36.069570 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:36.069434    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr" event={"ID":"34e9540a-d439-448d-a87e-356ea78e682d","Type":"ContainerDied","Data":"05e81c51381ca9f2f325ca99992320e1c842cec13af4a7027832185d2dbcc986"}
Sep 14 10:04:36.069570 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:36.069459    2581 scope.go:117] "RemoveContainer" containerID="a934db4a6cdd56b6bd447a00384ebd15798dc4e4268cd19d19528b25fd8bb3dc"
Sep 14 10:04:36.079744 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:36.079335    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pb6sh\" (UniqueName: \"kubernetes.io/projected/34e9540a-d439-448d-a87e-356ea78e682d-kube-api-access-pb6sh\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:36.079744 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:36.079366    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34e9540a-d439-448d-a87e-356ea78e682d-plugins-config-volume\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:04:36.082882 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:36.082860    2581 scope.go:117] "RemoveContainer" containerID="a934db4a6cdd56b6bd447a00384ebd15798dc4e4268cd19d19528b25fd8bb3dc"
Sep 14 10:04:36.083243 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:04:36.083221    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a934db4a6cdd56b6bd447a00384ebd15798dc4e4268cd19d19528b25fd8bb3dc\": container with ID starting with a934db4a6cdd56b6bd447a00384ebd15798dc4e4268cd19d19528b25fd8bb3dc not found: ID does not exist" containerID="a934db4a6cdd56b6bd447a00384ebd15798dc4e4268cd19d19528b25fd8bb3dc"
Sep 14 10:04:36.083315 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:36.083251    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a934db4a6cdd56b6bd447a00384ebd15798dc4e4268cd19d19528b25fd8bb3dc"} err="failed to get container status \"a934db4a6cdd56b6bd447a00384ebd15798dc4e4268cd19d19528b25fd8bb3dc\": rpc error: code = NotFound desc = could not find container \"a934db4a6cdd56b6bd447a00384ebd15798dc4e4268cd19d19528b25fd8bb3dc\": container with ID starting with a934db4a6cdd56b6bd447a00384ebd15798dc4e4268cd19d19528b25fd8bb3dc not found: ID does not exist"
Sep 14 10:04:36.104048 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:36.104011    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr"]
Sep 14 10:04:36.116997 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:36.116961    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-24873d-86899b95fd-xddvr"]
Sep 14 10:04:36.656577 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:36.656539    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34e9540a-d439-448d-a87e-356ea78e682d" path="/var/lib/kubelet/pods/34e9540a-d439-448d-a87e-356ea78e682d/volumes"
Sep 14 10:04:44.059941 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:44.059905    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2"
Sep 14 10:04:44.060387 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:44.060269    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq"
Sep 14 10:04:53.385130 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:04:53.385089    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:05:16.582269 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:16.582228    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:05:28.392703 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.392621    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"]
Sep 14 10:05:28.393298 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.393276    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34e9540a-d439-448d-a87e-356ea78e682d" containerName="payload-pre-processing"
Sep 14 10:05:28.393375 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.393301    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="34e9540a-d439-448d-a87e-356ea78e682d" containerName="payload-pre-processing"
Sep 14 10:05:28.393452 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.393440    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="34e9540a-d439-448d-a87e-356ea78e682d" containerName="payload-pre-processing"
Sep 14 10:05:28.397787 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.397765    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"
Sep 14 10:05:28.400634 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.400609    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-f4d054-serving-cert\""
Sep 14 10:05:28.409305 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.409279    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"]
Sep 14 10:05:28.542892 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.542853    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc826e01-970f-4831-8c6b-6639e8efbbd2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn\" (UID: \"dc826e01-970f-4831-8c6b-6639e8efbbd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"
Sep 14 10:05:28.543061 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.542910    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc826e01-970f-4831-8c6b-6639e8efbbd2-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn\" (UID: \"dc826e01-970f-4831-8c6b-6639e8efbbd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"
Sep 14 10:05:28.543116 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.543072    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht6zm\" (UniqueName: \"kubernetes.io/projected/dc826e01-970f-4831-8c6b-6639e8efbbd2-kube-api-access-ht6zm\") pod \"maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn\" (UID: \"dc826e01-970f-4831-8c6b-6639e8efbbd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"
Sep 14 10:05:28.543168 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.543126    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc826e01-970f-4831-8c6b-6639e8efbbd2-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn\" (UID: \"dc826e01-970f-4831-8c6b-6639e8efbbd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"
Sep 14 10:05:28.644581 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.644493    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc826e01-970f-4831-8c6b-6639e8efbbd2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn\" (UID: \"dc826e01-970f-4831-8c6b-6639e8efbbd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"
Sep 14 10:05:28.644581 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.644539    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc826e01-970f-4831-8c6b-6639e8efbbd2-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn\" (UID: \"dc826e01-970f-4831-8c6b-6639e8efbbd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"
Sep 14 10:05:28.644878 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.644619    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht6zm\" (UniqueName: \"kubernetes.io/projected/dc826e01-970f-4831-8c6b-6639e8efbbd2-kube-api-access-ht6zm\") pod \"maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn\" (UID: \"dc826e01-970f-4831-8c6b-6639e8efbbd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"
Sep 14 10:05:28.644878 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.644645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc826e01-970f-4831-8c6b-6639e8efbbd2-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn\" (UID: \"dc826e01-970f-4831-8c6b-6639e8efbbd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"
Sep 14 10:05:28.645241 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.645214    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc826e01-970f-4831-8c6b-6639e8efbbd2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn\" (UID: \"dc826e01-970f-4831-8c6b-6639e8efbbd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"
Sep 14 10:05:28.647245 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.647218    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc826e01-970f-4831-8c6b-6639e8efbbd2-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn\" (UID: \"dc826e01-970f-4831-8c6b-6639e8efbbd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"
Sep 14 10:05:28.647337 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.647225    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc826e01-970f-4831-8c6b-6639e8efbbd2-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn\" (UID: \"dc826e01-970f-4831-8c6b-6639e8efbbd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"
Sep 14 10:05:28.654050 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.654022    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht6zm\" (UniqueName: \"kubernetes.io/projected/dc826e01-970f-4831-8c6b-6639e8efbbd2-kube-api-access-ht6zm\") pod \"maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn\" (UID: \"dc826e01-970f-4831-8c6b-6639e8efbbd2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"
Sep 14 10:05:28.709101 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.709059    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"
Sep 14 10:05:28.988063 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.988020    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"]
Sep 14 10:05:28.989379 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:05:28.989349    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc826e01_970f_4831_8c6b_6639e8efbbd2.slice/crio-e9a48289c886a1609d1758fd1e9f0ec1c437e1c90a5718e2e04e92f76bd4eba2 WatchSource:0}: Error finding container e9a48289c886a1609d1758fd1e9f0ec1c437e1c90a5718e2e04e92f76bd4eba2: Status 404 returned error can't find the container with id e9a48289c886a1609d1758fd1e9f0ec1c437e1c90a5718e2e04e92f76bd4eba2
Sep 14 10:05:28.991209 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:28.991188    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 10:05:29.234352 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:29.234305    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh"]
Sep 14 10:05:29.239246 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:29.239175    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh"
Sep 14 10:05:29.242412 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:29.242387    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-f4d054-dockercfg-mwxlb\""
Sep 14 10:05:29.242533 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:29.242517    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-f4d054\""
Sep 14 10:05:29.250867 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:29.250836    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh"]
Sep 14 10:05:29.351057 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:29.351029    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvg7s\" (UniqueName: \"kubernetes.io/projected/f4209d28-2feb-467b-9da1-562968ed2f62-kube-api-access-jvg7s\") pod \"payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh\" (UID: \"f4209d28-2feb-467b-9da1-562968ed2f62\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh"
Sep 14 10:05:29.351194 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:29.351143    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4209d28-2feb-467b-9da1-562968ed2f62-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh\" (UID: \"f4209d28-2feb-467b-9da1-562968ed2f62\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh"
Sep 14 10:05:29.372057 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:29.372023    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn" event={"ID":"dc826e01-970f-4831-8c6b-6639e8efbbd2","Type":"ContainerStarted","Data":"e9a48289c886a1609d1758fd1e9f0ec1c437e1c90a5718e2e04e92f76bd4eba2"}
Sep 14 10:05:29.451904 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:29.451866    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvg7s\" (UniqueName: \"kubernetes.io/projected/f4209d28-2feb-467b-9da1-562968ed2f62-kube-api-access-jvg7s\") pod \"payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh\" (UID: \"f4209d28-2feb-467b-9da1-562968ed2f62\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh"
Sep 14 10:05:29.452364 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:29.451962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4209d28-2feb-467b-9da1-562968ed2f62-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh\" (UID: \"f4209d28-2feb-467b-9da1-562968ed2f62\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh"
Sep 14 10:05:29.452648 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:29.452626    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4209d28-2feb-467b-9da1-562968ed2f62-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh\" (UID: \"f4209d28-2feb-467b-9da1-562968ed2f62\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh"
Sep 14 10:05:29.460337 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:29.460311    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvg7s\" (UniqueName: \"kubernetes.io/projected/f4209d28-2feb-467b-9da1-562968ed2f62-kube-api-access-jvg7s\") pod \"payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh\" (UID: \"f4209d28-2feb-467b-9da1-562968ed2f62\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh"
Sep 14 10:05:29.553166 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:29.553071    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh"
Sep 14 10:05:29.832919 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:29.832890    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh"]
Sep 14 10:05:29.835259 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:05:29.835229    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4209d28_2feb_467b_9da1_562968ed2f62.slice/crio-a2dc18b3e835354fd2df2c741c32987f732d833c8b39af8ba6d3ebc5585001fc WatchSource:0}: Error finding container a2dc18b3e835354fd2df2c741c32987f732d833c8b39af8ba6d3ebc5585001fc: Status 404 returned error can't find the container with id a2dc18b3e835354fd2df2c741c32987f732d833c8b39af8ba6d3ebc5585001fc
Sep 14 10:05:30.379664 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:30.379627    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh" event={"ID":"f4209d28-2feb-467b-9da1-562968ed2f62","Type":"ContainerStarted","Data":"1d5aca113f352b0e353183586458655e6990f89de739b96573924e246212a614"}
Sep 14 10:05:30.379882 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:30.379688    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh" event={"ID":"f4209d28-2feb-467b-9da1-562968ed2f62","Type":"ContainerStarted","Data":"a2dc18b3e835354fd2df2c741c32987f732d833c8b39af8ba6d3ebc5585001fc"}
Sep 14 10:05:30.379882 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:30.379771    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh"
Sep 14 10:05:30.381368 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:30.381342    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn" event={"ID":"dc826e01-970f-4831-8c6b-6639e8efbbd2","Type":"ContainerStarted","Data":"e129de0528cf68715a452c1d5db4d0660600b1ea54b1419967001a1fc43f8d40"}
Sep 14 10:05:30.381484 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:30.381440    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"
Sep 14 10:05:30.412407 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:30.412350    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh" podStartSLOduration=1.412333619 podStartE2EDuration="1.412333619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:05:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:05:30.408992839 +0000 UTC m=+1346.267225205" watchObservedRunningTime="2026-09-14 10:05:30.412333619 +0000 UTC m=+1346.270565966"
Sep 14 10:05:30.442864 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:30.442801    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn" podStartSLOduration=2.105672134 podStartE2EDuration="2.442779156s" totalImagesPullingTime="337.107022ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:05:30.438367837 +0000 UTC m=+1346.296600194" watchObservedRunningTime="2026-09-14 10:05:30.442779156 +0000 UTC m=+1346.301011516"
Sep 14 10:05:36.392935 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:36.392898    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"
Sep 14 10:05:41.389962 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:41.389923    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh"
Sep 14 10:05:43.185933 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:05:43.185893    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:06:08.974990 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:08.974952    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:06:44.986280 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:44.986238    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:06:49.128777 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.128740    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2"]
Sep 14 10:06:49.129282 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.128995    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2" podUID="88954f40-46e0-4de1-9844-9b5f14115ae3" containerName="payload-processing" containerID="cri-o://2495e63c8d259f0ca6106eed3fc3cc400f191d35f775c5c047e0aa28cf3aae3c" gracePeriod=30
Sep 14 10:06:49.133072 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.133043    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq"]
Sep 14 10:06:49.133317 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.133291    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq" podUID="f6098be5-3509-46ff-b010-7fa74e312adf" containerName="payload-pre-processing" containerID="cri-o://23c09a0330e7912c1586783c4fd9dfcd32bc4de36a3b14a016b8928f6cb99821" gracePeriod=30
Sep 14 10:06:49.418628 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.418596    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq"
Sep 14 10:06:49.445431 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.444697    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2"
Sep 14 10:06:49.458595 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.458549    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6098be5-3509-46ff-b010-7fa74e312adf-plugins-config-volume\") pod \"f6098be5-3509-46ff-b010-7fa74e312adf\" (UID: \"f6098be5-3509-46ff-b010-7fa74e312adf\") "
Sep 14 10:06:49.458817 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.458645    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smpxc\" (UniqueName: \"kubernetes.io/projected/f6098be5-3509-46ff-b010-7fa74e312adf-kube-api-access-smpxc\") pod \"f6098be5-3509-46ff-b010-7fa74e312adf\" (UID: \"f6098be5-3509-46ff-b010-7fa74e312adf\") "
Sep 14 10:06:49.459165 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.459131    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6098be5-3509-46ff-b010-7fa74e312adf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f6098be5-3509-46ff-b010-7fa74e312adf" (UID: "f6098be5-3509-46ff-b010-7fa74e312adf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:06:49.469489 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.469445    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6098be5-3509-46ff-b010-7fa74e312adf-kube-api-access-smpxc" (OuterVolumeSpecName: "kube-api-access-smpxc") pod "f6098be5-3509-46ff-b010-7fa74e312adf" (UID: "f6098be5-3509-46ff-b010-7fa74e312adf"). InnerVolumeSpecName "kube-api-access-smpxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:06:49.559909 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.559866    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88954f40-46e0-4de1-9844-9b5f14115ae3-plugins-config-volume\") pod \"88954f40-46e0-4de1-9844-9b5f14115ae3\" (UID: \"88954f40-46e0-4de1-9844-9b5f14115ae3\") "
Sep 14 10:06:49.560107 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.559929    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm6mq\" (UniqueName: \"kubernetes.io/projected/88954f40-46e0-4de1-9844-9b5f14115ae3-kube-api-access-qm6mq\") pod \"88954f40-46e0-4de1-9844-9b5f14115ae3\" (UID: \"88954f40-46e0-4de1-9844-9b5f14115ae3\") "
Sep 14 10:06:49.560191 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.560177    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6098be5-3509-46ff-b010-7fa74e312adf-plugins-config-volume\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:06:49.560234 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.560194    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smpxc\" (UniqueName: \"kubernetes.io/projected/f6098be5-3509-46ff-b010-7fa74e312adf-kube-api-access-smpxc\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:06:49.560343 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.560314    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88954f40-46e0-4de1-9844-9b5f14115ae3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "88954f40-46e0-4de1-9844-9b5f14115ae3" (UID: "88954f40-46e0-4de1-9844-9b5f14115ae3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:06:49.562070 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.562045    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88954f40-46e0-4de1-9844-9b5f14115ae3-kube-api-access-qm6mq" (OuterVolumeSpecName: "kube-api-access-qm6mq") pod "88954f40-46e0-4de1-9844-9b5f14115ae3" (UID: "88954f40-46e0-4de1-9844-9b5f14115ae3"). InnerVolumeSpecName "kube-api-access-qm6mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:06:49.660999 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.660881    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm6mq\" (UniqueName: \"kubernetes.io/projected/88954f40-46e0-4de1-9844-9b5f14115ae3-kube-api-access-qm6mq\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:06:49.660999 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.660934    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88954f40-46e0-4de1-9844-9b5f14115ae3-plugins-config-volume\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:06:49.821847 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.821806    2581 generic.go:356] "Generic (PLEG): container finished" podID="88954f40-46e0-4de1-9844-9b5f14115ae3" containerID="2495e63c8d259f0ca6106eed3fc3cc400f191d35f775c5c047e0aa28cf3aae3c" exitCode=0
Sep 14 10:06:49.822029 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.821857    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2"
Sep 14 10:06:49.822029 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.821890    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2" event={"ID":"88954f40-46e0-4de1-9844-9b5f14115ae3","Type":"ContainerDied","Data":"2495e63c8d259f0ca6106eed3fc3cc400f191d35f775c5c047e0aa28cf3aae3c"}
Sep 14 10:06:49.822029 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.821945    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2" event={"ID":"88954f40-46e0-4de1-9844-9b5f14115ae3","Type":"ContainerDied","Data":"835d1a91c3ba660e415684d656dc62ef7fd73be9295e89085686200d59f6d1b1"}
Sep 14 10:06:49.822029 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.821968    2581 scope.go:117] "RemoveContainer" containerID="2495e63c8d259f0ca6106eed3fc3cc400f191d35f775c5c047e0aa28cf3aae3c"
Sep 14 10:06:49.823454 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.823432    2581 generic.go:356] "Generic (PLEG): container finished" podID="f6098be5-3509-46ff-b010-7fa74e312adf" containerID="23c09a0330e7912c1586783c4fd9dfcd32bc4de36a3b14a016b8928f6cb99821" exitCode=0
Sep 14 10:06:49.823572 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.823465    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq" event={"ID":"f6098be5-3509-46ff-b010-7fa74e312adf","Type":"ContainerDied","Data":"23c09a0330e7912c1586783c4fd9dfcd32bc4de36a3b14a016b8928f6cb99821"}
Sep 14 10:06:49.823572 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.823485    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq"
Sep 14 10:06:49.823572 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.823507    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq" event={"ID":"f6098be5-3509-46ff-b010-7fa74e312adf","Type":"ContainerDied","Data":"726a320170a0565273b7c948bdb4d348454c5b467eaee876030bb444e2efd16c"}
Sep 14 10:06:49.831931 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.831912    2581 scope.go:117] "RemoveContainer" containerID="2495e63c8d259f0ca6106eed3fc3cc400f191d35f775c5c047e0aa28cf3aae3c"
Sep 14 10:06:49.832299 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:06:49.832265    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2495e63c8d259f0ca6106eed3fc3cc400f191d35f775c5c047e0aa28cf3aae3c\": container with ID starting with 2495e63c8d259f0ca6106eed3fc3cc400f191d35f775c5c047e0aa28cf3aae3c not found: ID does not exist" containerID="2495e63c8d259f0ca6106eed3fc3cc400f191d35f775c5c047e0aa28cf3aae3c"
Sep 14 10:06:49.832418 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.832307    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2495e63c8d259f0ca6106eed3fc3cc400f191d35f775c5c047e0aa28cf3aae3c"} err="failed to get container status \"2495e63c8d259f0ca6106eed3fc3cc400f191d35f775c5c047e0aa28cf3aae3c\": rpc error: code = NotFound desc = could not find container \"2495e63c8d259f0ca6106eed3fc3cc400f191d35f775c5c047e0aa28cf3aae3c\": container with ID starting with 2495e63c8d259f0ca6106eed3fc3cc400f191d35f775c5c047e0aa28cf3aae3c not found: ID does not exist"
Sep 14 10:06:49.832418 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.832326    2581 scope.go:117] "RemoveContainer" containerID="23c09a0330e7912c1586783c4fd9dfcd32bc4de36a3b14a016b8928f6cb99821"
Sep 14 10:06:49.841503 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.841473    2581 scope.go:117] "RemoveContainer" containerID="23c09a0330e7912c1586783c4fd9dfcd32bc4de36a3b14a016b8928f6cb99821"
Sep 14 10:06:49.841983 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:06:49.841959    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23c09a0330e7912c1586783c4fd9dfcd32bc4de36a3b14a016b8928f6cb99821\": container with ID starting with 23c09a0330e7912c1586783c4fd9dfcd32bc4de36a3b14a016b8928f6cb99821 not found: ID does not exist" containerID="23c09a0330e7912c1586783c4fd9dfcd32bc4de36a3b14a016b8928f6cb99821"
Sep 14 10:06:49.842088 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.841994    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23c09a0330e7912c1586783c4fd9dfcd32bc4de36a3b14a016b8928f6cb99821"} err="failed to get container status \"23c09a0330e7912c1586783c4fd9dfcd32bc4de36a3b14a016b8928f6cb99821\": rpc error: code = NotFound desc = could not find container \"23c09a0330e7912c1586783c4fd9dfcd32bc4de36a3b14a016b8928f6cb99821\": container with ID starting with 23c09a0330e7912c1586783c4fd9dfcd32bc4de36a3b14a016b8928f6cb99821 not found: ID does not exist"
Sep 14 10:06:49.847240 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.847215    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq"]
Sep 14 10:06:49.851000 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.850977    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-75017ebc-8478bb77db-l49wq"]
Sep 14 10:06:49.868119 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.868090    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2"]
Sep 14 10:06:49.872206 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:49.872180    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-75017ebc-f4bf57c7-wnch2"]
Sep 14 10:06:50.656272 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:50.656224    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88954f40-46e0-4de1-9844-9b5f14115ae3" path="/var/lib/kubelet/pods/88954f40-46e0-4de1-9844-9b5f14115ae3/volumes"
Sep 14 10:06:50.656677 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:06:50.656637    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6098be5-3509-46ff-b010-7fa74e312adf" path="/var/lib/kubelet/pods/f6098be5-3509-46ff-b010-7fa74e312adf/volumes"
Sep 14 10:07:09.666822 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.666780    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"]
Sep 14 10:07:09.667292 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.667276    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88954f40-46e0-4de1-9844-9b5f14115ae3" containerName="payload-processing"
Sep 14 10:07:09.667338 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.667295    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="88954f40-46e0-4de1-9844-9b5f14115ae3" containerName="payload-processing"
Sep 14 10:07:09.667338 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.667320    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6098be5-3509-46ff-b010-7fa74e312adf" containerName="payload-pre-processing"
Sep 14 10:07:09.667338 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.667326    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6098be5-3509-46ff-b010-7fa74e312adf" containerName="payload-pre-processing"
Sep 14 10:07:09.667435 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.667393    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="88954f40-46e0-4de1-9844-9b5f14115ae3" containerName="payload-processing"
Sep 14 10:07:09.667435 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.667409    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6098be5-3509-46ff-b010-7fa74e312adf" containerName="payload-pre-processing"
Sep 14 10:07:09.672111 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.672092    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:09.674981 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.674956    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-2901ec\"/\"distinct-2-w4-2901ec-kserve-self-signed-certs\""
Sep 14 10:07:09.683570 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.683543    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"]
Sep 14 10:07:09.772222 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.772190    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/481dd875-3290-4ab0-8902-145f67b18dd7-tls-certs\") pod \"distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") " pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:09.772409 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.772240    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-dshm\") pod \"distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") " pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:09.772409 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.772277    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-tmp-dir\") pod \"distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") " pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:09.772409 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.772321    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb4s2\" (UniqueName: \"kubernetes.io/projected/481dd875-3290-4ab0-8902-145f67b18dd7-kube-api-access-bb4s2\") pod \"distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") " pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:09.772522 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.772442    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-model-cache\") pod \"distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") " pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:09.772558 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.772536    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-home\") pod \"distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") " pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:09.874056 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.874016    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-model-cache\") pod \"distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") " pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:09.874251 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.874128    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-home\") pod \"distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") " pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:09.874251 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.874154    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/481dd875-3290-4ab0-8902-145f67b18dd7-tls-certs\") pod \"distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") " pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:09.874251 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.874196    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-dshm\") pod \"distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") " pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:09.874251 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.874218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-tmp-dir\") pod \"distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") " pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:09.874251 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.874248    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb4s2\" (UniqueName: \"kubernetes.io/projected/481dd875-3290-4ab0-8902-145f67b18dd7-kube-api-access-bb4s2\") pod \"distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") " pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:09.874566 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.874532    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-model-cache\") pod \"distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") " pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:09.874736 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.874565    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-home\") pod \"distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") " pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:09.874736 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.874617    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-tmp-dir\") pod \"distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") " pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:09.876667 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.876646    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-dshm\") pod \"distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") " pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:09.876776 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.876702    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/481dd875-3290-4ab0-8902-145f67b18dd7-tls-certs\") pod \"distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") " pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:09.883108 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.883080    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb4s2\" (UniqueName: \"kubernetes.io/projected/481dd875-3290-4ab0-8902-145f67b18dd7-kube-api-access-bb4s2\") pod \"distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") " pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:09.981532 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:09.981486    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:10.267611 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:10.267581    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"]
Sep 14 10:07:10.946171 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:10.946134    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s" event={"ID":"481dd875-3290-4ab0-8902-145f67b18dd7","Type":"ContainerStarted","Data":"9570ca868564d7ba64d63b8fda8f414989b89dd2799cd41de10a9be4aba13e6d"}
Sep 14 10:07:10.946568 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:10.946187    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s" event={"ID":"481dd875-3290-4ab0-8902-145f67b18dd7","Type":"ContainerStarted","Data":"2536e372c4133c39ebbda3da5f1f6f058138a481413224f3c4a9ab5ed4bb59bf"}
Sep 14 10:07:10.972307 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:10.972251    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s" podStartSLOduration=1.9722352459999999 podStartE2EDuration="1.972235246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:07:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:07:10.970130001 +0000 UTC m=+1446.828362382" watchObservedRunningTime="2026-09-14 10:07:10.972235246 +0000 UTC m=+1446.830467601"
Sep 14 10:07:16.982239 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:16.982199    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:07:19.981784 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:19.981726    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:19.982174 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:19.981801    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:19.994607 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:19.994579    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:20.010949 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:20.010908    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:07:50.484739 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:07:50.484694    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:08:22.584803 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:22.584758    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:08:25.160445 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.160410    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"]
Sep 14 10:08:25.165017 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.164990    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:25.168322 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.168299    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-b6812e\"/\"embedding-w0-b6812e-kserve-self-signed-certs\""
Sep 14 10:08:25.177251 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.177224    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"]
Sep 14 10:08:25.257727 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.254916    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-model-cache\") pod \"embedding-w0-b6812e-kserve-5649698b7d-hg8fs\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") " pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:25.257727 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.254978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-tmp-dir\") pod \"embedding-w0-b6812e-kserve-5649698b7d-hg8fs\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") " pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:25.257727 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.255074    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq7mx\" (UniqueName: \"kubernetes.io/projected/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-kube-api-access-dq7mx\") pod \"embedding-w0-b6812e-kserve-5649698b7d-hg8fs\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") " pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:25.257727 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.255150    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-dshm\") pod \"embedding-w0-b6812e-kserve-5649698b7d-hg8fs\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") " pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:25.257727 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.255216    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-tls-certs\") pod \"embedding-w0-b6812e-kserve-5649698b7d-hg8fs\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") " pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:25.257727 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.255256    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-home\") pod \"embedding-w0-b6812e-kserve-5649698b7d-hg8fs\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") " pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:25.356727 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.356684    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq7mx\" (UniqueName: \"kubernetes.io/projected/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-kube-api-access-dq7mx\") pod \"embedding-w0-b6812e-kserve-5649698b7d-hg8fs\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") " pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:25.356894 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.356779    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-dshm\") pod \"embedding-w0-b6812e-kserve-5649698b7d-hg8fs\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") " pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:25.356894 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.356833    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-tls-certs\") pod \"embedding-w0-b6812e-kserve-5649698b7d-hg8fs\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") " pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:25.356894 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.356860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-home\") pod \"embedding-w0-b6812e-kserve-5649698b7d-hg8fs\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") " pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:25.357024 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.356993    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-model-cache\") pod \"embedding-w0-b6812e-kserve-5649698b7d-hg8fs\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") " pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:25.357082 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.357031    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-tmp-dir\") pod \"embedding-w0-b6812e-kserve-5649698b7d-hg8fs\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") " pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:25.357290 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.357267    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-home\") pod \"embedding-w0-b6812e-kserve-5649698b7d-hg8fs\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") " pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:25.357372 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.357321    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-model-cache\") pod \"embedding-w0-b6812e-kserve-5649698b7d-hg8fs\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") " pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:25.357420 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.357370    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-tmp-dir\") pod \"embedding-w0-b6812e-kserve-5649698b7d-hg8fs\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") " pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:25.359036 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.359013    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-dshm\") pod \"embedding-w0-b6812e-kserve-5649698b7d-hg8fs\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") " pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:25.359332 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.359314    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-tls-certs\") pod \"embedding-w0-b6812e-kserve-5649698b7d-hg8fs\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") " pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:25.366351 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.366328    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq7mx\" (UniqueName: \"kubernetes.io/projected/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-kube-api-access-dq7mx\") pod \"embedding-w0-b6812e-kserve-5649698b7d-hg8fs\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") " pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:25.477033 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.476994    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:25.759455 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:25.759425    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"]
Sep 14 10:08:25.761683 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:08:25.761655    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06f4ad76_ff24_47e5_a41f_6d022e7ae15d.slice/crio-421cacdc7b6e2c19356ca8e46bc7998d65a85de88edd3ca4edb8d555c706ef57 WatchSource:0}: Error finding container 421cacdc7b6e2c19356ca8e46bc7998d65a85de88edd3ca4edb8d555c706ef57: Status 404 returned error can't find the container with id 421cacdc7b6e2c19356ca8e46bc7998d65a85de88edd3ca4edb8d555c706ef57
Sep 14 10:08:26.360255 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:26.360217    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs" event={"ID":"06f4ad76-ff24-47e5-a41f-6d022e7ae15d","Type":"ContainerStarted","Data":"78e20383ccae91fffbac241fa7019778ea9d486c3ca06d216964bdac324210c8"}
Sep 14 10:08:26.360630 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:26.360267    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs" event={"ID":"06f4ad76-ff24-47e5-a41f-6d022e7ae15d","Type":"ContainerStarted","Data":"421cacdc7b6e2c19356ca8e46bc7998d65a85de88edd3ca4edb8d555c706ef57"}
Sep 14 10:08:26.389776 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:26.389716    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs" podStartSLOduration=1.389687723 podStartE2EDuration="1.389687723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:08:26.387564189 +0000 UTC m=+1522.245796576" watchObservedRunningTime="2026-09-14 10:08:26.389687723 +0000 UTC m=+1522.247920079"
Sep 14 10:08:35.477834 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:35.477788    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:35.480349 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:35.477852    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:35.491029 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:35.490999    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:36.428347 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:36.428317    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:08:39.325259 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.325217    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"]
Sep 14 10:08:39.328884 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.328860    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.334261 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.334237    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-29794e-openshift-default-dockercfg-nt79h\""
Sep 14 10:08:39.368453 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.368412    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"]
Sep 14 10:08:39.403103 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.403062    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5fs4\" (UniqueName: \"kubernetes.io/projected/495ef1e1-7c58-4b68-831d-cb515d1e9112-kube-api-access-m5fs4\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.403276 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.403113    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-token\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.403276 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.403134    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-podinfo\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.403276 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.403213    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/495ef1e1-7c58-4b68-831d-cb515d1e9112-istiod-ca-cert\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.403276 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.403242    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-workload-certs\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.403416 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.403305    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-workload-socket\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.403416 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.403368    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-envoy\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.403416 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.403410    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-data\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.403513 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.403438    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-credential-socket\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.504552 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.504512    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5fs4\" (UniqueName: \"kubernetes.io/projected/495ef1e1-7c58-4b68-831d-cb515d1e9112-kube-api-access-m5fs4\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.504764 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.504678    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-token\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.504843 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.504765    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-podinfo\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.504899 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.504843    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/495ef1e1-7c58-4b68-831d-cb515d1e9112-istiod-ca-cert\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.504899 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.504876    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-workload-certs\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.505030 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.504998    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-workload-socket\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.505089 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.505072    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-envoy\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.505168 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.505149    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-data\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.505250 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.505199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-credential-socket\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.505437 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.505403    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-workload-certs\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.505597 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.505574    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-workload-socket\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.505675 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.505618    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-credential-socket\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.505675 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.505637    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-data\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.505821 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.505702    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/495ef1e1-7c58-4b68-831d-cb515d1e9112-istiod-ca-cert\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.507457 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.507436    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-envoy\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.507701 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.507683    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-podinfo\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.521498 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.521463    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-token\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.521647 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.521545    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5fs4\" (UniqueName: \"kubernetes.io/projected/495ef1e1-7c58-4b68-831d-cb515d1e9112-kube-api-access-m5fs4\") pod \"e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") " pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.640253 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.640166    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:39.940392 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.940369    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"]
Sep 14 10:08:39.942121 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:08:39.942094    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod495ef1e1_7c58_4b68_831d_cb515d1e9112.slice/crio-4abb9bea155e828778bff64f7a0dc72ac578b53fb9ea3e231e314df9fea7e37a WatchSource:0}: Error finding container 4abb9bea155e828778bff64f7a0dc72ac578b53fb9ea3e231e314df9fea7e37a: Status 404 returned error can't find the container with id 4abb9bea155e828778bff64f7a0dc72ac578b53fb9ea3e231e314df9fea7e37a
Sep 14 10:08:39.944472 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.944442    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 10:08:39.944543 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.944511    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 10:08:39.944543 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:39.944539    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 10:08:40.445665 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:40.445621    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc" event={"ID":"495ef1e1-7c58-4b68-831d-cb515d1e9112","Type":"ContainerStarted","Data":"14c93ad1b2165653bc1bf7b1c280c95c42c31d61a53332025b0623debe6a4865"}
Sep 14 10:08:40.446077 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:40.445737    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc" event={"ID":"495ef1e1-7c58-4b68-831d-cb515d1e9112","Type":"ContainerStarted","Data":"4abb9bea155e828778bff64f7a0dc72ac578b53fb9ea3e231e314df9fea7e37a"}
Sep 14 10:08:40.502459 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:40.502389    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc" podStartSLOduration=1.502365817 podStartE2EDuration="1.502365817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:08:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:08:40.500102654 +0000 UTC m=+1536.358335011" watchObservedRunningTime="2026-09-14 10:08:40.502365817 +0000 UTC m=+1536.360598174"
Sep 14 10:08:40.640753 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:40.640698    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:41.646188 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:41.646157    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:42.458219 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:42.458189    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:08:42.459352 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:08:42.459329    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:09:05.889678 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:05.889574    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:09:16.662909 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:16.662871    2581 generic.go:356] "Generic (PLEG): container finished" podID="495ef1e1-7c58-4b68-831d-cb515d1e9112" containerID="14c93ad1b2165653bc1bf7b1c280c95c42c31d61a53332025b0623debe6a4865" exitCode=0
Sep 14 10:09:16.663328 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:16.662934    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc" event={"ID":"495ef1e1-7c58-4b68-831d-cb515d1e9112","Type":"ContainerDied","Data":"14c93ad1b2165653bc1bf7b1c280c95c42c31d61a53332025b0623debe6a4865"}
Sep 14 10:09:16.663418 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:16.663401    2581 scope.go:117] "RemoveContainer" containerID="14c93ad1b2165653bc1bf7b1c280c95c42c31d61a53332025b0623debe6a4865"
Sep 14 10:09:16.664628 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:16.664594    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 10:09:16.664761 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:16.664689    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 10:09:16.664846 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:16.664782    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 14 10:09:17.671378 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:17.671332    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc" event={"ID":"495ef1e1-7c58-4b68-831d-cb515d1e9112","Type":"ContainerStarted","Data":"2f3b354a52901a247dfb9880dcf37e5f4aec34ec893ba6b0fec5450eedbcec25"}
Sep 14 10:09:18.640401 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:18.640355    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:09:18.640766 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:18.640743    2581 patch_prober.go:28] interesting pod/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 14 10:09:18.640846 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:18.640794    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc" podUID="495ef1e1-7c58-4b68-831d-cb515d1e9112" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 14 10:09:19.081433 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.081393    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t"]
Sep 14 10:09:19.083993 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.083975    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t"
Sep 14 10:09:19.086849 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.086822    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-03fd6d-dockercfg-ldpmg\""
Sep 14 10:09:19.087001 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.086981    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-03fd6d\""
Sep 14 10:09:19.097526 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.097488    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t"]
Sep 14 10:09:19.143226 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.143192    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7"]
Sep 14 10:09:19.146605 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.146569    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7"
Sep 14 10:09:19.157539 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.157510    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p42fn\" (UniqueName: \"kubernetes.io/projected/aa730b5e-ba9e-49e7-b802-2fa93257a4ce-kube-api-access-p42fn\") pod \"payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t\" (UID: \"aa730b5e-ba9e-49e7-b802-2fa93257a4ce\") " pod="openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t"
Sep 14 10:09:19.157801 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.157776    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa730b5e-ba9e-49e7-b802-2fa93257a4ce-plugins-config-volume\") pod \"payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t\" (UID: \"aa730b5e-ba9e-49e7-b802-2fa93257a4ce\") " pod="openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t"
Sep 14 10:09:19.159233 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.159204    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7"]
Sep 14 10:09:19.259117 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.259082    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p42fn\" (UniqueName: \"kubernetes.io/projected/aa730b5e-ba9e-49e7-b802-2fa93257a4ce-kube-api-access-p42fn\") pod \"payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t\" (UID: \"aa730b5e-ba9e-49e7-b802-2fa93257a4ce\") " pod="openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t"
Sep 14 10:09:19.259307 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.259139    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xnxt\" (UniqueName: \"kubernetes.io/projected/23787b52-fe29-4f2f-8b65-7b051874fe3d-kube-api-access-5xnxt\") pod \"payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7\" (UID: \"23787b52-fe29-4f2f-8b65-7b051874fe3d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7"
Sep 14 10:09:19.259307 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.259185    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa730b5e-ba9e-49e7-b802-2fa93257a4ce-plugins-config-volume\") pod \"payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t\" (UID: \"aa730b5e-ba9e-49e7-b802-2fa93257a4ce\") " pod="openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t"
Sep 14 10:09:19.259307 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.259261    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23787b52-fe29-4f2f-8b65-7b051874fe3d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7\" (UID: \"23787b52-fe29-4f2f-8b65-7b051874fe3d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7"
Sep 14 10:09:19.259968 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.259946    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa730b5e-ba9e-49e7-b802-2fa93257a4ce-plugins-config-volume\") pod \"payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t\" (UID: \"aa730b5e-ba9e-49e7-b802-2fa93257a4ce\") " pod="openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t"
Sep 14 10:09:19.276648 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.276614    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p42fn\" (UniqueName: \"kubernetes.io/projected/aa730b5e-ba9e-49e7-b802-2fa93257a4ce-kube-api-access-p42fn\") pod \"payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t\" (UID: \"aa730b5e-ba9e-49e7-b802-2fa93257a4ce\") " pod="openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t"
Sep 14 10:09:19.360488 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.360391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23787b52-fe29-4f2f-8b65-7b051874fe3d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7\" (UID: \"23787b52-fe29-4f2f-8b65-7b051874fe3d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7"
Sep 14 10:09:19.360488 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.360480    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xnxt\" (UniqueName: \"kubernetes.io/projected/23787b52-fe29-4f2f-8b65-7b051874fe3d-kube-api-access-5xnxt\") pod \"payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7\" (UID: \"23787b52-fe29-4f2f-8b65-7b051874fe3d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7"
Sep 14 10:09:19.361510 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.361482    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23787b52-fe29-4f2f-8b65-7b051874fe3d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7\" (UID: \"23787b52-fe29-4f2f-8b65-7b051874fe3d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7"
Sep 14 10:09:19.372052 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.372022    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xnxt\" (UniqueName: \"kubernetes.io/projected/23787b52-fe29-4f2f-8b65-7b051874fe3d-kube-api-access-5xnxt\") pod \"payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7\" (UID: \"23787b52-fe29-4f2f-8b65-7b051874fe3d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7"
Sep 14 10:09:19.399368 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.399137    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t"
Sep 14 10:09:19.460188 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.460146    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7"
Sep 14 10:09:19.641840 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.641744    2581 patch_prober.go:28] interesting pod/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 14 10:09:19.641840 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.641802    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc" podUID="495ef1e1-7c58-4b68-831d-cb515d1e9112" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 14 10:09:19.715336 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.713262    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t"]
Sep 14 10:09:19.726308 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:09:19.726232    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa730b5e_ba9e_49e7_b802_2fa93257a4ce.slice/crio-1126b91fb0e861d5c699958c245647b6d7cfbe3a143a6fbf7afb79e6f9857270 WatchSource:0}: Error finding container 1126b91fb0e861d5c699958c245647b6d7cfbe3a143a6fbf7afb79e6f9857270: Status 404 returned error can't find the container with id 1126b91fb0e861d5c699958c245647b6d7cfbe3a143a6fbf7afb79e6f9857270
Sep 14 10:09:19.785916 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:19.785848    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7"]
Sep 14 10:09:19.788442 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:09:19.788393    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23787b52_fe29_4f2f_8b65_7b051874fe3d.slice/crio-93b09bfc262bee1d7bb6d2029d36fe36e4671ca5eb7b19d0d652f864567975c1 WatchSource:0}: Error finding container 93b09bfc262bee1d7bb6d2029d36fe36e4671ca5eb7b19d0d652f864567975c1: Status 404 returned error can't find the container with id 93b09bfc262bee1d7bb6d2029d36fe36e4671ca5eb7b19d0d652f864567975c1
Sep 14 10:09:20.640990 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:20.640959    2581 patch_prober.go:28] interesting pod/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 14 10:09:20.641431 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:20.641406    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc" podUID="495ef1e1-7c58-4b68-831d-cb515d1e9112" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 14 10:09:20.693112 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:20.693078    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t" event={"ID":"aa730b5e-ba9e-49e7-b802-2fa93257a4ce","Type":"ContainerStarted","Data":"1a128cf921d1fcbe309835e8201858f2349dd4e7460933dbe9d6391517d89a9b"}
Sep 14 10:09:20.693319 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:20.693250    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t" event={"ID":"aa730b5e-ba9e-49e7-b802-2fa93257a4ce","Type":"ContainerStarted","Data":"1126b91fb0e861d5c699958c245647b6d7cfbe3a143a6fbf7afb79e6f9857270"}
Sep 14 10:09:20.693319 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:20.693288    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t"
Sep 14 10:09:20.701729 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:20.694822    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7" event={"ID":"23787b52-fe29-4f2f-8b65-7b051874fe3d","Type":"ContainerStarted","Data":"26fd84137a5c95aec755be56db340c2e43af1e8946f920e89d2c5e85269835f9"}
Sep 14 10:09:20.702036 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:20.702008    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7" event={"ID":"23787b52-fe29-4f2f-8b65-7b051874fe3d","Type":"ContainerStarted","Data":"93b09bfc262bee1d7bb6d2029d36fe36e4671ca5eb7b19d0d652f864567975c1"}
Sep 14 10:09:20.702149 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:20.702138    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7"
Sep 14 10:09:20.716735 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:20.715903    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t" podStartSLOduration=1.7158782540000002 podStartE2EDuration="1.715878254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:09:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:09:20.715003112 +0000 UTC m=+1576.573235468" watchObservedRunningTime="2026-09-14 10:09:20.715878254 +0000 UTC m=+1576.574110627"
Sep 14 10:09:20.738121 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:20.738028    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7" podStartSLOduration=1.738007522 podStartE2EDuration="1.738007522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:09:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:09:20.736632388 +0000 UTC m=+1576.594864735" watchObservedRunningTime="2026-09-14 10:09:20.738007522 +0000 UTC m=+1576.596239878"
Sep 14 10:09:21.640729 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:21.640683    2581 patch_prober.go:28] interesting pod/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 14 10:09:21.640975 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:21.640950    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc" podUID="495ef1e1-7c58-4b68-831d-cb515d1e9112" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 14 10:09:22.641530 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:22.641478    2581 patch_prober.go:28] interesting pod/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 14 10:09:22.641954 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:22.641575    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc" podUID="495ef1e1-7c58-4b68-831d-cb515d1e9112" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 14 10:09:23.645858 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:23.645827    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:09:23.646244 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:23.646148    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:09:23.646864 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:23.646844    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:09:31.706408 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:31.706369    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7"
Sep 14 10:09:31.706870 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:31.706450    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t"
Sep 14 10:09:46.384723 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:09:46.384655    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:10:07.451535 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:07.451452    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"]
Sep 14 10:10:07.451939 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:07.451677    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc" podUID="495ef1e1-7c58-4b68-831d-cb515d1e9112" containerName="istio-proxy" containerID="cri-o://2f3b354a52901a247dfb9880dcf37e5f4aec34ec893ba6b0fec5450eedbcec25" gracePeriod=30
Sep 14 10:10:08.649170 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:08.649121    2581 patch_prober.go:28] interesting pod/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 14 10:10:08.649587 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:08.649213    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc" podUID="495ef1e1-7c58-4b68-831d-cb515d1e9112" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 14 10:10:12.722265 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.722187    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:10:12.841735 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.841664    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-workload-certs\") pod \"495ef1e1-7c58-4b68-831d-cb515d1e9112\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") "
Sep 14 10:10:12.841735 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.841734    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-data\") pod \"495ef1e1-7c58-4b68-831d-cb515d1e9112\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") "
Sep 14 10:10:12.842010 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.841776    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/495ef1e1-7c58-4b68-831d-cb515d1e9112-istiod-ca-cert\") pod \"495ef1e1-7c58-4b68-831d-cb515d1e9112\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") "
Sep 14 10:10:12.842010 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.841797    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-podinfo\") pod \"495ef1e1-7c58-4b68-831d-cb515d1e9112\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") "
Sep 14 10:10:12.842010 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.841871    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-token\") pod \"495ef1e1-7c58-4b68-831d-cb515d1e9112\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") "
Sep 14 10:10:12.842010 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.841891    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5fs4\" (UniqueName: \"kubernetes.io/projected/495ef1e1-7c58-4b68-831d-cb515d1e9112-kube-api-access-m5fs4\") pod \"495ef1e1-7c58-4b68-831d-cb515d1e9112\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") "
Sep 14 10:10:12.842010 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.841914    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-workload-socket\") pod \"495ef1e1-7c58-4b68-831d-cb515d1e9112\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") "
Sep 14 10:10:12.842010 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.841951    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-credential-socket\") pod \"495ef1e1-7c58-4b68-831d-cb515d1e9112\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") "
Sep 14 10:10:12.842010 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.841975    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "495ef1e1-7c58-4b68-831d-cb515d1e9112" (UID: "495ef1e1-7c58-4b68-831d-cb515d1e9112"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:12.842356 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.842030    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-envoy\") pod \"495ef1e1-7c58-4b68-831d-cb515d1e9112\" (UID: \"495ef1e1-7c58-4b68-831d-cb515d1e9112\") "
Sep 14 10:10:12.842356 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.842071    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-data" (OuterVolumeSpecName: "istio-data") pod "495ef1e1-7c58-4b68-831d-cb515d1e9112" (UID: "495ef1e1-7c58-4b68-831d-cb515d1e9112"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:12.842356 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.842318    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "495ef1e1-7c58-4b68-831d-cb515d1e9112" (UID: "495ef1e1-7c58-4b68-831d-cb515d1e9112"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:12.842356 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.842221    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/495ef1e1-7c58-4b68-831d-cb515d1e9112-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "495ef1e1-7c58-4b68-831d-cb515d1e9112" (UID: "495ef1e1-7c58-4b68-831d-cb515d1e9112"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:10:12.842356 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.842330    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "495ef1e1-7c58-4b68-831d-cb515d1e9112" (UID: "495ef1e1-7c58-4b68-831d-cb515d1e9112"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:12.842601 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.842376    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-workload-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:12.842601 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.842395    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-data\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:12.844482 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.844447    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "495ef1e1-7c58-4b68-831d-cb515d1e9112" (UID: "495ef1e1-7c58-4b68-831d-cb515d1e9112"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 10:10:12.844602 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.844479    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "495ef1e1-7c58-4b68-831d-cb515d1e9112" (UID: "495ef1e1-7c58-4b68-831d-cb515d1e9112"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:12.844602 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.844487    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-token" (OuterVolumeSpecName: "istio-token") pod "495ef1e1-7c58-4b68-831d-cb515d1e9112" (UID: "495ef1e1-7c58-4b68-831d-cb515d1e9112"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:10:12.844602 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.844539    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/495ef1e1-7c58-4b68-831d-cb515d1e9112-kube-api-access-m5fs4" (OuterVolumeSpecName: "kube-api-access-m5fs4") pod "495ef1e1-7c58-4b68-831d-cb515d1e9112" (UID: "495ef1e1-7c58-4b68-831d-cb515d1e9112"). InnerVolumeSpecName "kube-api-access-m5fs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:10:12.943166 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.943110    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-workload-socket\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:12.943166 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.943155    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-credential-socket\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:12.943166 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.943170    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-envoy\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:12.943424 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.943182    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/495ef1e1-7c58-4b68-831d-cb515d1e9112-istiod-ca-cert\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:12.943424 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.943193    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-podinfo\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:12.943424 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.943203    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/495ef1e1-7c58-4b68-831d-cb515d1e9112-istio-token\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:12.943424 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:12.943215    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5fs4\" (UniqueName: \"kubernetes.io/projected/495ef1e1-7c58-4b68-831d-cb515d1e9112-kube-api-access-m5fs4\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:13.021797 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:13.021672    2581 generic.go:356] "Generic (PLEG): container finished" podID="495ef1e1-7c58-4b68-831d-cb515d1e9112" containerID="2f3b354a52901a247dfb9880dcf37e5f4aec34ec893ba6b0fec5450eedbcec25" exitCode=0
Sep 14 10:10:13.021797 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:13.021742    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"
Sep 14 10:10:13.021797 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:13.021764    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc" event={"ID":"495ef1e1-7c58-4b68-831d-cb515d1e9112","Type":"ContainerDied","Data":"2f3b354a52901a247dfb9880dcf37e5f4aec34ec893ba6b0fec5450eedbcec25"}
Sep 14 10:10:13.022040 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:13.021828    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc" event={"ID":"495ef1e1-7c58-4b68-831d-cb515d1e9112","Type":"ContainerDied","Data":"4abb9bea155e828778bff64f7a0dc72ac578b53fb9ea3e231e314df9fea7e37a"}
Sep 14 10:10:13.022040 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:13.021858    2581 scope.go:117] "RemoveContainer" containerID="2f3b354a52901a247dfb9880dcf37e5f4aec34ec893ba6b0fec5450eedbcec25"
Sep 14 10:10:13.032038 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:13.032018    2581 scope.go:117] "RemoveContainer" containerID="14c93ad1b2165653bc1bf7b1c280c95c42c31d61a53332025b0623debe6a4865"
Sep 14 10:10:13.040995 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:13.040974    2581 scope.go:117] "RemoveContainer" containerID="2f3b354a52901a247dfb9880dcf37e5f4aec34ec893ba6b0fec5450eedbcec25"
Sep 14 10:10:13.041316 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:10:13.041296    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f3b354a52901a247dfb9880dcf37e5f4aec34ec893ba6b0fec5450eedbcec25\": container with ID starting with 2f3b354a52901a247dfb9880dcf37e5f4aec34ec893ba6b0fec5450eedbcec25 not found: ID does not exist" containerID="2f3b354a52901a247dfb9880dcf37e5f4aec34ec893ba6b0fec5450eedbcec25"
Sep 14 10:10:13.041399 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:13.041331    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f3b354a52901a247dfb9880dcf37e5f4aec34ec893ba6b0fec5450eedbcec25"} err="failed to get container status \"2f3b354a52901a247dfb9880dcf37e5f4aec34ec893ba6b0fec5450eedbcec25\": rpc error: code = NotFound desc = could not find container \"2f3b354a52901a247dfb9880dcf37e5f4aec34ec893ba6b0fec5450eedbcec25\": container with ID starting with 2f3b354a52901a247dfb9880dcf37e5f4aec34ec893ba6b0fec5450eedbcec25 not found: ID does not exist"
Sep 14 10:10:13.041399 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:13.041360    2581 scope.go:117] "RemoveContainer" containerID="14c93ad1b2165653bc1bf7b1c280c95c42c31d61a53332025b0623debe6a4865"
Sep 14 10:10:13.041671 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:10:13.041652    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14c93ad1b2165653bc1bf7b1c280c95c42c31d61a53332025b0623debe6a4865\": container with ID starting with 14c93ad1b2165653bc1bf7b1c280c95c42c31d61a53332025b0623debe6a4865 not found: ID does not exist" containerID="14c93ad1b2165653bc1bf7b1c280c95c42c31d61a53332025b0623debe6a4865"
Sep 14 10:10:13.041729 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:13.041677    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14c93ad1b2165653bc1bf7b1c280c95c42c31d61a53332025b0623debe6a4865"} err="failed to get container status \"14c93ad1b2165653bc1bf7b1c280c95c42c31d61a53332025b0623debe6a4865\": rpc error: code = NotFound desc = could not find container \"14c93ad1b2165653bc1bf7b1c280c95c42c31d61a53332025b0623debe6a4865\": container with ID starting with 14c93ad1b2165653bc1bf7b1c280c95c42c31d61a53332025b0623debe6a4865 not found: ID does not exist"
Sep 14 10:10:13.047058 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:13.047030    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"]
Sep 14 10:10:13.051270 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:13.051243    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-29794e-openshift-default-859c8489c6-4s2cc"]
Sep 14 10:10:13.610205 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:13.610170    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"]
Sep 14 10:10:13.640522 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:13.640486    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"]
Sep 14 10:10:14.658571 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:14.658530    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="495ef1e1-7c58-4b68-831d-cb515d1e9112" path="/var/lib/kubelet/pods/495ef1e1-7c58-4b68-831d-cb515d1e9112/volumes"
Sep 14 10:10:19.265204 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:19.265164    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:10:23.839873 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:23.839837    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t"]
Sep 14 10:10:23.840369 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:23.840071    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t" podUID="aa730b5e-ba9e-49e7-b802-2fa93257a4ce" containerName="payload-processing" containerID="cri-o://1a128cf921d1fcbe309835e8201858f2349dd4e7460933dbe9d6391517d89a9b" gracePeriod=30
Sep 14 10:10:23.848209 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:23.848000    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7"]
Sep 14 10:10:23.848295 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:23.848248    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7" podUID="23787b52-fe29-4f2f-8b65-7b051874fe3d" containerName="payload-pre-processing" containerID="cri-o://26fd84137a5c95aec755be56db340c2e43af1e8946f920e89d2c5e85269835f9" gracePeriod=30
Sep 14 10:10:24.094037 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:24.093999    2581 generic.go:356] "Generic (PLEG): container finished" podID="23787b52-fe29-4f2f-8b65-7b051874fe3d" containerID="26fd84137a5c95aec755be56db340c2e43af1e8946f920e89d2c5e85269835f9" exitCode=0
Sep 14 10:10:24.094183 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:24.094154    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7" event={"ID":"23787b52-fe29-4f2f-8b65-7b051874fe3d","Type":"ContainerDied","Data":"26fd84137a5c95aec755be56db340c2e43af1e8946f920e89d2c5e85269835f9"}
Sep 14 10:10:24.095844 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:24.095820    2581 generic.go:356] "Generic (PLEG): container finished" podID="aa730b5e-ba9e-49e7-b802-2fa93257a4ce" containerID="1a128cf921d1fcbe309835e8201858f2349dd4e7460933dbe9d6391517d89a9b" exitCode=0
Sep 14 10:10:24.095964 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:24.095901    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t" event={"ID":"aa730b5e-ba9e-49e7-b802-2fa93257a4ce","Type":"ContainerDied","Data":"1a128cf921d1fcbe309835e8201858f2349dd4e7460933dbe9d6391517d89a9b"}
Sep 14 10:10:24.095964 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:24.095957    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t" event={"ID":"aa730b5e-ba9e-49e7-b802-2fa93257a4ce","Type":"ContainerDied","Data":"1126b91fb0e861d5c699958c245647b6d7cfbe3a143a6fbf7afb79e6f9857270"}
Sep 14 10:10:24.096041 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:24.095982    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1126b91fb0e861d5c699958c245647b6d7cfbe3a143a6fbf7afb79e6f9857270"
Sep 14 10:10:24.110271 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:24.110247    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t"
Sep 14 10:10:24.139754 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:24.139726    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7"
Sep 14 10:10:24.174947 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:24.174904    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p42fn\" (UniqueName: \"kubernetes.io/projected/aa730b5e-ba9e-49e7-b802-2fa93257a4ce-kube-api-access-p42fn\") pod \"aa730b5e-ba9e-49e7-b802-2fa93257a4ce\" (UID: \"aa730b5e-ba9e-49e7-b802-2fa93257a4ce\") "
Sep 14 10:10:24.175151 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:24.174986    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa730b5e-ba9e-49e7-b802-2fa93257a4ce-plugins-config-volume\") pod \"aa730b5e-ba9e-49e7-b802-2fa93257a4ce\" (UID: \"aa730b5e-ba9e-49e7-b802-2fa93257a4ce\") "
Sep 14 10:10:24.175648 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:24.175616    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa730b5e-ba9e-49e7-b802-2fa93257a4ce-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aa730b5e-ba9e-49e7-b802-2fa93257a4ce" (UID: "aa730b5e-ba9e-49e7-b802-2fa93257a4ce"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:10:24.177358 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:24.177334    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa730b5e-ba9e-49e7-b802-2fa93257a4ce-kube-api-access-p42fn" (OuterVolumeSpecName: "kube-api-access-p42fn") pod "aa730b5e-ba9e-49e7-b802-2fa93257a4ce" (UID: "aa730b5e-ba9e-49e7-b802-2fa93257a4ce"). InnerVolumeSpecName "kube-api-access-p42fn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:10:24.276905 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:24.276862    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23787b52-fe29-4f2f-8b65-7b051874fe3d-plugins-config-volume\") pod \"23787b52-fe29-4f2f-8b65-7b051874fe3d\" (UID: \"23787b52-fe29-4f2f-8b65-7b051874fe3d\") "
Sep 14 10:10:24.277085 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:24.277037    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xnxt\" (UniqueName: \"kubernetes.io/projected/23787b52-fe29-4f2f-8b65-7b051874fe3d-kube-api-access-5xnxt\") pod \"23787b52-fe29-4f2f-8b65-7b051874fe3d\" (UID: \"23787b52-fe29-4f2f-8b65-7b051874fe3d\") "
Sep 14 10:10:24.277364 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:24.277330    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23787b52-fe29-4f2f-8b65-7b051874fe3d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "23787b52-fe29-4f2f-8b65-7b051874fe3d" (UID: "23787b52-fe29-4f2f-8b65-7b051874fe3d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:10:24.277489 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:24.277366    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p42fn\" (UniqueName: \"kubernetes.io/projected/aa730b5e-ba9e-49e7-b802-2fa93257a4ce-kube-api-access-p42fn\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:24.277489 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:24.277388    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa730b5e-ba9e-49e7-b802-2fa93257a4ce-plugins-config-volume\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:24.279290 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:24.279267    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23787b52-fe29-4f2f-8b65-7b051874fe3d-kube-api-access-5xnxt" (OuterVolumeSpecName: "kube-api-access-5xnxt") pod "23787b52-fe29-4f2f-8b65-7b051874fe3d" (UID: "23787b52-fe29-4f2f-8b65-7b051874fe3d"). InnerVolumeSpecName "kube-api-access-5xnxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:10:24.378353 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:24.378268    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xnxt\" (UniqueName: \"kubernetes.io/projected/23787b52-fe29-4f2f-8b65-7b051874fe3d-kube-api-access-5xnxt\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:24.378353 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:24.378295    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23787b52-fe29-4f2f-8b65-7b051874fe3d-plugins-config-volume\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:25.102726 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:25.102679    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7"
Sep 14 10:10:25.103199 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:25.102733    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7" event={"ID":"23787b52-fe29-4f2f-8b65-7b051874fe3d","Type":"ContainerDied","Data":"93b09bfc262bee1d7bb6d2029d36fe36e4671ca5eb7b19d0d652f864567975c1"}
Sep 14 10:10:25.103199 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:25.102799    2581 scope.go:117] "RemoveContainer" containerID="26fd84137a5c95aec755be56db340c2e43af1e8946f920e89d2c5e85269835f9"
Sep 14 10:10:25.103199 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:25.102979    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t"
Sep 14 10:10:25.120656 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:25.120625    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t"]
Sep 14 10:10:25.127190 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:25.127158    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-03fd6d-7894bc4dc9-mhf9t"]
Sep 14 10:10:25.140999 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:25.140964    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7"]
Sep 14 10:10:25.143131 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:25.143105    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-03fd6d-5cc784fdf8-dv5n7"]
Sep 14 10:10:26.657869 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:26.657824    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23787b52-fe29-4f2f-8b65-7b051874fe3d" path="/var/lib/kubelet/pods/23787b52-fe29-4f2f-8b65-7b051874fe3d/volumes"
Sep 14 10:10:26.658379 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:26.658359    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa730b5e-ba9e-49e7-b802-2fa93257a4ce" path="/var/lib/kubelet/pods/aa730b5e-ba9e-49e7-b802-2fa93257a4ce/volumes"
Sep 14 10:10:28.631351 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:28.631229    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs" podUID="06f4ad76-ff24-47e5-a41f-6d022e7ae15d" containerName="main" containerID="cri-o://78e20383ccae91fffbac241fa7019778ea9d486c3ca06d216964bdac324210c8" gracePeriod=45
Sep 14 10:10:28.660987 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:28.660926    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s" podUID="674dc0c9-b738-4844-8b73-25381039ac2f" containerName="main" containerID="cri-o://767c63024e57e911c7eb89c1150bf239de26b6b165cb3eca989168875defb22d" gracePeriod=45
Sep 14 10:10:28.791564 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:28.791511    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s" podUID="674dc0c9-b738-4844-8b73-25381039ac2f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.56:8000/ready\": dial tcp 10.133.0.56:8000: connect: connection refused"
Sep 14 10:10:28.841863 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:28.840958    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"]
Sep 14 10:10:28.841863 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:28.841220    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg" podUID="5197ca13-8f47-40d9-a297-fb2ab1f02899" containerName="maas-api" containerID="cri-o://7d143a9a4f7c482ee74feb264cfb3746d0eae17dd1c5505c2cc7189ed8c596eb" gracePeriod=30
Sep 14 10:10:28.990332 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:28.990302    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:10:28.994302 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:28.994273    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:10:29.134141 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.134107    2581 generic.go:356] "Generic (PLEG): container finished" podID="06f4ad76-ff24-47e5-a41f-6d022e7ae15d" containerID="78e20383ccae91fffbac241fa7019778ea9d486c3ca06d216964bdac324210c8" exitCode=0
Sep 14 10:10:29.134141 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.134147    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"
Sep 14 10:10:29.134368 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.134185    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs" event={"ID":"06f4ad76-ff24-47e5-a41f-6d022e7ae15d","Type":"ContainerDied","Data":"78e20383ccae91fffbac241fa7019778ea9d486c3ca06d216964bdac324210c8"}
Sep 14 10:10:29.134368 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.134232    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs" event={"ID":"06f4ad76-ff24-47e5-a41f-6d022e7ae15d","Type":"ContainerDied","Data":"421cacdc7b6e2c19356ca8e46bc7998d65a85de88edd3ca4edb8d555c706ef57"}
Sep 14 10:10:29.134368 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.134256    2581 scope.go:117] "RemoveContainer" containerID="78e20383ccae91fffbac241fa7019778ea9d486c3ca06d216964bdac324210c8"
Sep 14 10:10:29.135930 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.135696    2581 generic.go:356] "Generic (PLEG): container finished" podID="5197ca13-8f47-40d9-a297-fb2ab1f02899" containerID="7d143a9a4f7c482ee74feb264cfb3746d0eae17dd1c5505c2cc7189ed8c596eb" exitCode=0
Sep 14 10:10:29.135930 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.135815    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg" event={"ID":"5197ca13-8f47-40d9-a297-fb2ab1f02899","Type":"ContainerDied","Data":"7d143a9a4f7c482ee74feb264cfb3746d0eae17dd1c5505c2cc7189ed8c596eb"}
Sep 14 10:10:29.136149 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.136127    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-model-cache\") pod \"674dc0c9-b738-4844-8b73-25381039ac2f\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") "
Sep 14 10:10:29.136216 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.136197    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-dshm\") pod \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") "
Sep 14 10:10:29.136294 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.136279    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/674dc0c9-b738-4844-8b73-25381039ac2f-tls-certs\") pod \"674dc0c9-b738-4844-8b73-25381039ac2f\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") "
Sep 14 10:10:29.136358 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.136309    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-tls-certs\") pod \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") "
Sep 14 10:10:29.136358 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.136335    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2w2d\" (UniqueName: \"kubernetes.io/projected/674dc0c9-b738-4844-8b73-25381039ac2f-kube-api-access-f2w2d\") pod \"674dc0c9-b738-4844-8b73-25381039ac2f\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") "
Sep 14 10:10:29.136542 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.136377    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-home\") pod \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") "
Sep 14 10:10:29.136542 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.136401    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-home\") pod \"674dc0c9-b738-4844-8b73-25381039ac2f\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") "
Sep 14 10:10:29.136542 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.136478    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-tmp-dir\") pod \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") "
Sep 14 10:10:29.136542 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.136485    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-model-cache" (OuterVolumeSpecName: "model-cache") pod "674dc0c9-b738-4844-8b73-25381039ac2f" (UID: "674dc0c9-b738-4844-8b73-25381039ac2f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:29.136823 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.136549    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-tmp-dir\") pod \"674dc0c9-b738-4844-8b73-25381039ac2f\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") "
Sep 14 10:10:29.136823 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.136602    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq7mx\" (UniqueName: \"kubernetes.io/projected/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-kube-api-access-dq7mx\") pod \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") "
Sep 14 10:10:29.136823 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.136631    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-dshm\") pod \"674dc0c9-b738-4844-8b73-25381039ac2f\" (UID: \"674dc0c9-b738-4844-8b73-25381039ac2f\") "
Sep 14 10:10:29.136823 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.136667    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-model-cache\") pod \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\" (UID: \"06f4ad76-ff24-47e5-a41f-6d022e7ae15d\") "
Sep 14 10:10:29.136823 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.136764    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-home" (OuterVolumeSpecName: "home") pod "06f4ad76-ff24-47e5-a41f-6d022e7ae15d" (UID: "06f4ad76-ff24-47e5-a41f-6d022e7ae15d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:29.137094 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.136947    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "674dc0c9-b738-4844-8b73-25381039ac2f" (UID: "674dc0c9-b738-4844-8b73-25381039ac2f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:29.137150 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.137125    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-tmp-dir\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:29.137207 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.137147    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-model-cache\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:29.137207 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.137161    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-home\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:29.137533 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.137510    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-model-cache" (OuterVolumeSpecName: "model-cache") pod "06f4ad76-ff24-47e5-a41f-6d022e7ae15d" (UID: "06f4ad76-ff24-47e5-a41f-6d022e7ae15d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:29.137679 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.137657    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-home" (OuterVolumeSpecName: "home") pod "674dc0c9-b738-4844-8b73-25381039ac2f" (UID: "674dc0c9-b738-4844-8b73-25381039ac2f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:29.137924 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.137902    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "06f4ad76-ff24-47e5-a41f-6d022e7ae15d" (UID: "06f4ad76-ff24-47e5-a41f-6d022e7ae15d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:29.139791 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.139748    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-kube-api-access-dq7mx" (OuterVolumeSpecName: "kube-api-access-dq7mx") pod "06f4ad76-ff24-47e5-a41f-6d022e7ae15d" (UID: "06f4ad76-ff24-47e5-a41f-6d022e7ae15d"). InnerVolumeSpecName "kube-api-access-dq7mx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:10:29.140167 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.140134    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "06f4ad76-ff24-47e5-a41f-6d022e7ae15d" (UID: "06f4ad76-ff24-47e5-a41f-6d022e7ae15d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:10:29.140745 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.140332    2581 generic.go:356] "Generic (PLEG): container finished" podID="674dc0c9-b738-4844-8b73-25381039ac2f" containerID="767c63024e57e911c7eb89c1150bf239de26b6b165cb3eca989168875defb22d" exitCode=0
Sep 14 10:10:29.140745 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.140387    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"
Sep 14 10:10:29.140745 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.140390    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-dshm" (OuterVolumeSpecName: "dshm") pod "06f4ad76-ff24-47e5-a41f-6d022e7ae15d" (UID: "06f4ad76-ff24-47e5-a41f-6d022e7ae15d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:29.140745 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.140384    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s" event={"ID":"674dc0c9-b738-4844-8b73-25381039ac2f","Type":"ContainerDied","Data":"767c63024e57e911c7eb89c1150bf239de26b6b165cb3eca989168875defb22d"}
Sep 14 10:10:29.140745 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.140436    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s" event={"ID":"674dc0c9-b738-4844-8b73-25381039ac2f","Type":"ContainerDied","Data":"d75333a11c2ab5f7d84927f7304ea40038988b26969c65695b335e152642891b"}
Sep 14 10:10:29.141155 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.141128    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/674dc0c9-b738-4844-8b73-25381039ac2f-kube-api-access-f2w2d" (OuterVolumeSpecName: "kube-api-access-f2w2d") pod "674dc0c9-b738-4844-8b73-25381039ac2f" (UID: "674dc0c9-b738-4844-8b73-25381039ac2f"). InnerVolumeSpecName "kube-api-access-f2w2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:10:29.141412 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.141384    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/674dc0c9-b738-4844-8b73-25381039ac2f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "674dc0c9-b738-4844-8b73-25381039ac2f" (UID: "674dc0c9-b738-4844-8b73-25381039ac2f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:10:29.141491 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.141423    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-dshm" (OuterVolumeSpecName: "dshm") pod "674dc0c9-b738-4844-8b73-25381039ac2f" (UID: "674dc0c9-b738-4844-8b73-25381039ac2f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:29.145241 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.145219    2581 scope.go:117] "RemoveContainer" containerID="78e20383ccae91fffbac241fa7019778ea9d486c3ca06d216964bdac324210c8"
Sep 14 10:10:29.145584 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:10:29.145551    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78e20383ccae91fffbac241fa7019778ea9d486c3ca06d216964bdac324210c8\": container with ID starting with 78e20383ccae91fffbac241fa7019778ea9d486c3ca06d216964bdac324210c8 not found: ID does not exist" containerID="78e20383ccae91fffbac241fa7019778ea9d486c3ca06d216964bdac324210c8"
Sep 14 10:10:29.145637 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.145596    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78e20383ccae91fffbac241fa7019778ea9d486c3ca06d216964bdac324210c8"} err="failed to get container status \"78e20383ccae91fffbac241fa7019778ea9d486c3ca06d216964bdac324210c8\": rpc error: code = NotFound desc = could not find container \"78e20383ccae91fffbac241fa7019778ea9d486c3ca06d216964bdac324210c8\": container with ID starting with 78e20383ccae91fffbac241fa7019778ea9d486c3ca06d216964bdac324210c8 not found: ID does not exist"
Sep 14 10:10:29.145637 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.145616    2581 scope.go:117] "RemoveContainer" containerID="767c63024e57e911c7eb89c1150bf239de26b6b165cb3eca989168875defb22d"
Sep 14 10:10:29.150118 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.150094    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"
Sep 14 10:10:29.154508 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.154488    2581 scope.go:117] "RemoveContainer" containerID="767c63024e57e911c7eb89c1150bf239de26b6b165cb3eca989168875defb22d"
Sep 14 10:10:29.154856 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:10:29.154837    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"767c63024e57e911c7eb89c1150bf239de26b6b165cb3eca989168875defb22d\": container with ID starting with 767c63024e57e911c7eb89c1150bf239de26b6b165cb3eca989168875defb22d not found: ID does not exist" containerID="767c63024e57e911c7eb89c1150bf239de26b6b165cb3eca989168875defb22d"
Sep 14 10:10:29.154915 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.154865    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"767c63024e57e911c7eb89c1150bf239de26b6b165cb3eca989168875defb22d"} err="failed to get container status \"767c63024e57e911c7eb89c1150bf239de26b6b165cb3eca989168875defb22d\": rpc error: code = NotFound desc = could not find container \"767c63024e57e911c7eb89c1150bf239de26b6b165cb3eca989168875defb22d\": container with ID starting with 767c63024e57e911c7eb89c1150bf239de26b6b165cb3eca989168875defb22d not found: ID does not exist"
Sep 14 10:10:29.237680 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.237588    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kn2f\" (UniqueName: \"kubernetes.io/projected/5197ca13-8f47-40d9-a297-fb2ab1f02899-kube-api-access-5kn2f\") pod \"5197ca13-8f47-40d9-a297-fb2ab1f02899\" (UID: \"5197ca13-8f47-40d9-a297-fb2ab1f02899\") "
Sep 14 10:10:29.237680 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.237631    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5197ca13-8f47-40d9-a297-fb2ab1f02899-metrics-certs\") pod \"5197ca13-8f47-40d9-a297-fb2ab1f02899\" (UID: \"5197ca13-8f47-40d9-a297-fb2ab1f02899\") "
Sep 14 10:10:29.237680 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.237661    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5197ca13-8f47-40d9-a297-fb2ab1f02899-openshift-service-ca\") pod \"5197ca13-8f47-40d9-a297-fb2ab1f02899\" (UID: \"5197ca13-8f47-40d9-a297-fb2ab1f02899\") "
Sep 14 10:10:29.237983 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.237733    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5197ca13-8f47-40d9-a297-fb2ab1f02899-maas-api-tls\") pod \"5197ca13-8f47-40d9-a297-fb2ab1f02899\" (UID: \"5197ca13-8f47-40d9-a297-fb2ab1f02899\") "
Sep 14 10:10:29.238292 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.238152    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-home\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:29.238292 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.238180    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-tmp-dir\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:29.238292 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.238175    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5197ca13-8f47-40d9-a297-fb2ab1f02899-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5197ca13-8f47-40d9-a297-fb2ab1f02899" (UID: "5197ca13-8f47-40d9-a297-fb2ab1f02899"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:10:29.238292 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.238196    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq7mx\" (UniqueName: \"kubernetes.io/projected/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-kube-api-access-dq7mx\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:29.238292 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.238210    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/674dc0c9-b738-4844-8b73-25381039ac2f-dshm\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:29.238292 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.238222    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-model-cache\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:29.238292 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.238236    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-dshm\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:29.238292 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.238246    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/674dc0c9-b738-4844-8b73-25381039ac2f-tls-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:29.238292 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.238257    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06f4ad76-ff24-47e5-a41f-6d022e7ae15d-tls-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:29.238292 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.238269    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2w2d\" (UniqueName: \"kubernetes.io/projected/674dc0c9-b738-4844-8b73-25381039ac2f-kube-api-access-f2w2d\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:29.240160 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.240123    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5197ca13-8f47-40d9-a297-fb2ab1f02899-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5197ca13-8f47-40d9-a297-fb2ab1f02899" (UID: "5197ca13-8f47-40d9-a297-fb2ab1f02899"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:10:29.240263 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.240126    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5197ca13-8f47-40d9-a297-fb2ab1f02899-kube-api-access-5kn2f" (OuterVolumeSpecName: "kube-api-access-5kn2f") pod "5197ca13-8f47-40d9-a297-fb2ab1f02899" (UID: "5197ca13-8f47-40d9-a297-fb2ab1f02899"). InnerVolumeSpecName "kube-api-access-5kn2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:10:29.240263 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.240225    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5197ca13-8f47-40d9-a297-fb2ab1f02899-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5197ca13-8f47-40d9-a297-fb2ab1f02899" (UID: "5197ca13-8f47-40d9-a297-fb2ab1f02899"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:10:29.339270 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.339219    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kn2f\" (UniqueName: \"kubernetes.io/projected/5197ca13-8f47-40d9-a297-fb2ab1f02899-kube-api-access-5kn2f\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:29.339438 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.339258    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5197ca13-8f47-40d9-a297-fb2ab1f02899-metrics-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:29.339438 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.339295    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5197ca13-8f47-40d9-a297-fb2ab1f02899-openshift-service-ca\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:29.339438 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.339307    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5197ca13-8f47-40d9-a297-fb2ab1f02899-maas-api-tls\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:29.459420 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.459368    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"]
Sep 14 10:10:29.462166 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.462123    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-b6812e/embedding-w0-b6812e-kserve-5649698b7d-hg8fs"]
Sep 14 10:10:29.475814 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.475769    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"]
Sep 14 10:10:29.479319 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:29.479289    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-b6812e/premium-w0-b6812e-kserve-7fdfc4b54-xtc6s"]
Sep 14 10:10:30.147023 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:30.146981    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"
Sep 14 10:10:30.147023 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:30.146989    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg" event={"ID":"5197ca13-8f47-40d9-a297-fb2ab1f02899","Type":"ContainerDied","Data":"4d058b629cc6b9bf4d65bdf6a0faa31cadcebfc0b417210c9b3559b9bdc7faec"}
Sep 14 10:10:30.147583 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:30.147062    2581 scope.go:117] "RemoveContainer" containerID="7d143a9a4f7c482ee74feb264cfb3746d0eae17dd1c5505c2cc7189ed8c596eb"
Sep 14 10:10:30.172868 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:30.172834    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"]
Sep 14 10:10:30.173490 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:10:30.173466    2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5197ca13_8f47_40d9_a297_fb2ab1f02899.slice\": RecentStats: unable to find data in memory cache]"
Sep 14 10:10:30.176799 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:30.176768    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-b6812e-6c8b96f98-wz8vg"]
Sep 14 10:10:30.657905 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:30.657869    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06f4ad76-ff24-47e5-a41f-6d022e7ae15d" path="/var/lib/kubelet/pods/06f4ad76-ff24-47e5-a41f-6d022e7ae15d/volumes"
Sep 14 10:10:30.658325 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:30.658309    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5197ca13-8f47-40d9-a297-fb2ab1f02899" path="/var/lib/kubelet/pods/5197ca13-8f47-40d9-a297-fb2ab1f02899/volumes"
Sep 14 10:10:30.658683 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:30.658670    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="674dc0c9-b738-4844-8b73-25381039ac2f" path="/var/lib/kubelet/pods/674dc0c9-b738-4844-8b73-25381039ac2f/volumes"
Sep 14 10:10:32.334585 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:32.334543    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"]
Sep 14 10:10:32.369109 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:32.369069    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"]
Sep 14 10:10:43.939660 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:43.939620    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"]
Sep 14 10:10:43.940082 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:43.939955    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg" podUID="d53e8b31-b1b9-4c4c-99b2-8212c9078b4d" containerName="maas-api" containerID="cri-o://681229f9318fd76c393a8afa1c03e6477df26ace9e3da025f712ad6012cc3c20" gracePeriod=30
Sep 14 10:10:44.214252 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.214217    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"
Sep 14 10:10:44.245638 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.245601    2581 generic.go:356] "Generic (PLEG): container finished" podID="d53e8b31-b1b9-4c4c-99b2-8212c9078b4d" containerID="681229f9318fd76c393a8afa1c03e6477df26ace9e3da025f712ad6012cc3c20" exitCode=0
Sep 14 10:10:44.245858 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.245659    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"
Sep 14 10:10:44.245953 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.245666    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg" event={"ID":"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d","Type":"ContainerDied","Data":"681229f9318fd76c393a8afa1c03e6477df26ace9e3da025f712ad6012cc3c20"}
Sep 14 10:10:44.246117 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.246091    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg" event={"ID":"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d","Type":"ContainerDied","Data":"87e33f3a1626827f6a1cec66c64839f4684d75b51a90e1a205d1f25affdd85df"}
Sep 14 10:10:44.246244 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.246138    2581 scope.go:117] "RemoveContainer" containerID="681229f9318fd76c393a8afa1c03e6477df26ace9e3da025f712ad6012cc3c20"
Sep 14 10:10:44.257267 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.257233    2581 scope.go:117] "RemoveContainer" containerID="681229f9318fd76c393a8afa1c03e6477df26ace9e3da025f712ad6012cc3c20"
Sep 14 10:10:44.257665 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:10:44.257642    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"681229f9318fd76c393a8afa1c03e6477df26ace9e3da025f712ad6012cc3c20\": container with ID starting with 681229f9318fd76c393a8afa1c03e6477df26ace9e3da025f712ad6012cc3c20 not found: ID does not exist" containerID="681229f9318fd76c393a8afa1c03e6477df26ace9e3da025f712ad6012cc3c20"
Sep 14 10:10:44.257755 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.257678    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"681229f9318fd76c393a8afa1c03e6477df26ace9e3da025f712ad6012cc3c20"} err="failed to get container status \"681229f9318fd76c393a8afa1c03e6477df26ace9e3da025f712ad6012cc3c20\": rpc error: code = NotFound desc = could not find container \"681229f9318fd76c393a8afa1c03e6477df26ace9e3da025f712ad6012cc3c20\": container with ID starting with 681229f9318fd76c393a8afa1c03e6477df26ace9e3da025f712ad6012cc3c20 not found: ID does not exist"
Sep 14 10:10:44.291053 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.291013    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-maas-api-tls\") pod \"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d\" (UID: \"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d\") "
Sep 14 10:10:44.291245 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.291067    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cshq7\" (UniqueName: \"kubernetes.io/projected/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-kube-api-access-cshq7\") pod \"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d\" (UID: \"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d\") "
Sep 14 10:10:44.291245 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.291114    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-metrics-certs\") pod \"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d\" (UID: \"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d\") "
Sep 14 10:10:44.291245 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.291142    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-openshift-service-ca\") pod \"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d\" (UID: \"d53e8b31-b1b9-4c4c-99b2-8212c9078b4d\") "
Sep 14 10:10:44.291577 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.291547    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d53e8b31-b1b9-4c4c-99b2-8212c9078b4d" (UID: "d53e8b31-b1b9-4c4c-99b2-8212c9078b4d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:10:44.293358 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.293330    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d53e8b31-b1b9-4c4c-99b2-8212c9078b4d" (UID: "d53e8b31-b1b9-4c4c-99b2-8212c9078b4d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:10:44.293445 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.293354    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d53e8b31-b1b9-4c4c-99b2-8212c9078b4d" (UID: "d53e8b31-b1b9-4c4c-99b2-8212c9078b4d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:10:44.293445 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.293385    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-kube-api-access-cshq7" (OuterVolumeSpecName: "kube-api-access-cshq7") pod "d53e8b31-b1b9-4c4c-99b2-8212c9078b4d" (UID: "d53e8b31-b1b9-4c4c-99b2-8212c9078b4d"). InnerVolumeSpecName "kube-api-access-cshq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:10:44.391982 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.391948    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-metrics-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:44.391982 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.391978    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-openshift-service-ca\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:44.391982 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.391988    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-maas-api-tls\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:44.392224 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.391998    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cshq7\" (UniqueName: \"kubernetes.io/projected/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d-kube-api-access-cshq7\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:44.603317 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.603280    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"]
Sep 14 10:10:44.616630 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.616596    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2901ec-595bdbcb6b-6mqvg"]
Sep 14 10:10:44.656822 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:44.656774    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d53e8b31-b1b9-4c4c-99b2-8212c9078b4d" path="/var/lib/kubelet/pods/d53e8b31-b1b9-4c4c-99b2-8212c9078b4d/volumes"
Sep 14 10:10:47.355877 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.355831    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s" podUID="481dd875-3290-4ab0-8902-145f67b18dd7" containerName="main" containerID="cri-o://9570ca868564d7ba64d63b8fda8f414989b89dd2799cd41de10a9be4aba13e6d" gracePeriod=45
Sep 14 10:10:47.388900 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.388828    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j" podUID="190aceb5-32fc-4061-8c69-8e284c7591c9" containerName="main" containerID="cri-o://e54897c4eeaf6e05711b3b697d01e0d39b32d6efa35ece18f0542cfdcf9b53aa" gracePeriod=45
Sep 14 10:10:47.645909 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.645878    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:10:47.677875 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.677844    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:10:47.721529 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.721491    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/190aceb5-32fc-4061-8c69-8e284c7591c9-tls-certs\") pod \"190aceb5-32fc-4061-8c69-8e284c7591c9\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") "
Sep 14 10:10:47.721529 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.721537    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-tmp-dir\") pod \"190aceb5-32fc-4061-8c69-8e284c7591c9\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") "
Sep 14 10:10:47.721811 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.721597    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-home\") pod \"481dd875-3290-4ab0-8902-145f67b18dd7\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") "
Sep 14 10:10:47.721811 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.721632    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-tmp-dir\") pod \"481dd875-3290-4ab0-8902-145f67b18dd7\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") "
Sep 14 10:10:47.721811 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.721653    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-model-cache\") pod \"190aceb5-32fc-4061-8c69-8e284c7591c9\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") "
Sep 14 10:10:47.721811 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.721695    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-model-cache\") pod \"481dd875-3290-4ab0-8902-145f67b18dd7\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") "
Sep 14 10:10:47.721811 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.721769    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/481dd875-3290-4ab0-8902-145f67b18dd7-tls-certs\") pod \"481dd875-3290-4ab0-8902-145f67b18dd7\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") "
Sep 14 10:10:47.721811 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.721797    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bb4s2\" (UniqueName: \"kubernetes.io/projected/481dd875-3290-4ab0-8902-145f67b18dd7-kube-api-access-bb4s2\") pod \"481dd875-3290-4ab0-8902-145f67b18dd7\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") "
Sep 14 10:10:47.722138 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.721827    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-dshm\") pod \"190aceb5-32fc-4061-8c69-8e284c7591c9\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") "
Sep 14 10:10:47.722138 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.721862    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-dshm\") pod \"481dd875-3290-4ab0-8902-145f67b18dd7\" (UID: \"481dd875-3290-4ab0-8902-145f67b18dd7\") "
Sep 14 10:10:47.722138 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.721889    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xlr5\" (UniqueName: \"kubernetes.io/projected/190aceb5-32fc-4061-8c69-8e284c7591c9-kube-api-access-9xlr5\") pod \"190aceb5-32fc-4061-8c69-8e284c7591c9\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") "
Sep 14 10:10:47.722138 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.721898    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-home" (OuterVolumeSpecName: "home") pod "481dd875-3290-4ab0-8902-145f67b18dd7" (UID: "481dd875-3290-4ab0-8902-145f67b18dd7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:47.722138 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.721934    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-home\") pod \"190aceb5-32fc-4061-8c69-8e284c7591c9\" (UID: \"190aceb5-32fc-4061-8c69-8e284c7591c9\") "
Sep 14 10:10:47.722138 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.721933    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "190aceb5-32fc-4061-8c69-8e284c7591c9" (UID: "190aceb5-32fc-4061-8c69-8e284c7591c9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:47.722526 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.722374    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-home" (OuterVolumeSpecName: "home") pod "190aceb5-32fc-4061-8c69-8e284c7591c9" (UID: "190aceb5-32fc-4061-8c69-8e284c7591c9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:47.722526 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.722390    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-tmp-dir\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:47.722526 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.722409    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-home\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:47.722686 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.722579    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-model-cache" (OuterVolumeSpecName: "model-cache") pod "190aceb5-32fc-4061-8c69-8e284c7591c9" (UID: "190aceb5-32fc-4061-8c69-8e284c7591c9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:47.723037 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.722944    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "481dd875-3290-4ab0-8902-145f67b18dd7" (UID: "481dd875-3290-4ab0-8902-145f67b18dd7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:47.723338 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.723306    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-model-cache" (OuterVolumeSpecName: "model-cache") pod "481dd875-3290-4ab0-8902-145f67b18dd7" (UID: "481dd875-3290-4ab0-8902-145f67b18dd7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:47.724471 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.724441    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/190aceb5-32fc-4061-8c69-8e284c7591c9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "190aceb5-32fc-4061-8c69-8e284c7591c9" (UID: "190aceb5-32fc-4061-8c69-8e284c7591c9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:10:47.724594 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.724524    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-dshm" (OuterVolumeSpecName: "dshm") pod "481dd875-3290-4ab0-8902-145f67b18dd7" (UID: "481dd875-3290-4ab0-8902-145f67b18dd7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:47.724594 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.724578    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-dshm" (OuterVolumeSpecName: "dshm") pod "190aceb5-32fc-4061-8c69-8e284c7591c9" (UID: "190aceb5-32fc-4061-8c69-8e284c7591c9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:47.725605 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.725366    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/190aceb5-32fc-4061-8c69-8e284c7591c9-kube-api-access-9xlr5" (OuterVolumeSpecName: "kube-api-access-9xlr5") pod "190aceb5-32fc-4061-8c69-8e284c7591c9" (UID: "190aceb5-32fc-4061-8c69-8e284c7591c9"). InnerVolumeSpecName "kube-api-access-9xlr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:10:47.725605 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.725590    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/481dd875-3290-4ab0-8902-145f67b18dd7-kube-api-access-bb4s2" (OuterVolumeSpecName: "kube-api-access-bb4s2") pod "481dd875-3290-4ab0-8902-145f67b18dd7" (UID: "481dd875-3290-4ab0-8902-145f67b18dd7"). InnerVolumeSpecName "kube-api-access-bb4s2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:10:47.726017 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.725979    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/481dd875-3290-4ab0-8902-145f67b18dd7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "481dd875-3290-4ab0-8902-145f67b18dd7" (UID: "481dd875-3290-4ab0-8902-145f67b18dd7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:10:47.823812 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.823769    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-dshm\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:47.823812 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.823811    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-dshm\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:47.823999 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.823825    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xlr5\" (UniqueName: \"kubernetes.io/projected/190aceb5-32fc-4061-8c69-8e284c7591c9-kube-api-access-9xlr5\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:47.823999 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.823840    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-home\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:47.823999 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.823853    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/190aceb5-32fc-4061-8c69-8e284c7591c9-tls-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:47.823999 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.823866    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-tmp-dir\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:47.823999 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.823878    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/190aceb5-32fc-4061-8c69-8e284c7591c9-model-cache\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:47.823999 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.823901    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/481dd875-3290-4ab0-8902-145f67b18dd7-model-cache\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:47.823999 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.823914    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/481dd875-3290-4ab0-8902-145f67b18dd7-tls-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:47.823999 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:47.823927    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bb4s2\" (UniqueName: \"kubernetes.io/projected/481dd875-3290-4ab0-8902-145f67b18dd7-kube-api-access-bb4s2\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:48.276150 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:48.276082    2581 generic.go:356] "Generic (PLEG): container finished" podID="481dd875-3290-4ab0-8902-145f67b18dd7" containerID="9570ca868564d7ba64d63b8fda8f414989b89dd2799cd41de10a9be4aba13e6d" exitCode=0
Sep 14 10:10:48.276150 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:48.276165    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"
Sep 14 10:10:48.276629 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:48.276202    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s" event={"ID":"481dd875-3290-4ab0-8902-145f67b18dd7","Type":"ContainerDied","Data":"9570ca868564d7ba64d63b8fda8f414989b89dd2799cd41de10a9be4aba13e6d"}
Sep 14 10:10:48.276629 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:48.276293    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s" event={"ID":"481dd875-3290-4ab0-8902-145f67b18dd7","Type":"ContainerDied","Data":"2536e372c4133c39ebbda3da5f1f6f058138a481413224f3c4a9ab5ed4bb59bf"}
Sep 14 10:10:48.276629 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:48.276326    2581 scope.go:117] "RemoveContainer" containerID="9570ca868564d7ba64d63b8fda8f414989b89dd2799cd41de10a9be4aba13e6d"
Sep 14 10:10:48.279089 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:48.278982    2581 generic.go:356] "Generic (PLEG): container finished" podID="190aceb5-32fc-4061-8c69-8e284c7591c9" containerID="e54897c4eeaf6e05711b3b697d01e0d39b32d6efa35ece18f0542cfdcf9b53aa" exitCode=0
Sep 14 10:10:48.279089 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:48.279062    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j" event={"ID":"190aceb5-32fc-4061-8c69-8e284c7591c9","Type":"ContainerDied","Data":"e54897c4eeaf6e05711b3b697d01e0d39b32d6efa35ece18f0542cfdcf9b53aa"}
Sep 14 10:10:48.279388 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:48.279087    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"
Sep 14 10:10:48.279388 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:48.279182    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j" event={"ID":"190aceb5-32fc-4061-8c69-8e284c7591c9","Type":"ContainerDied","Data":"0683cf4fd4a95f7289417ce748913a2a52c14e00f61dde424028d575cf0a4404"}
Sep 14 10:10:48.296559 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:48.296436    2581 scope.go:117] "RemoveContainer" containerID="9570ca868564d7ba64d63b8fda8f414989b89dd2799cd41de10a9be4aba13e6d"
Sep 14 10:10:48.297284 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:10:48.297243    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9570ca868564d7ba64d63b8fda8f414989b89dd2799cd41de10a9be4aba13e6d\": container with ID starting with 9570ca868564d7ba64d63b8fda8f414989b89dd2799cd41de10a9be4aba13e6d not found: ID does not exist" containerID="9570ca868564d7ba64d63b8fda8f414989b89dd2799cd41de10a9be4aba13e6d"
Sep 14 10:10:48.297406 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:48.297309    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9570ca868564d7ba64d63b8fda8f414989b89dd2799cd41de10a9be4aba13e6d"} err="failed to get container status \"9570ca868564d7ba64d63b8fda8f414989b89dd2799cd41de10a9be4aba13e6d\": rpc error: code = NotFound desc = could not find container \"9570ca868564d7ba64d63b8fda8f414989b89dd2799cd41de10a9be4aba13e6d\": container with ID starting with 9570ca868564d7ba64d63b8fda8f414989b89dd2799cd41de10a9be4aba13e6d not found: ID does not exist"
Sep 14 10:10:48.297406 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:48.297354    2581 scope.go:117] "RemoveContainer" containerID="e54897c4eeaf6e05711b3b697d01e0d39b32d6efa35ece18f0542cfdcf9b53aa"
Sep 14 10:10:48.315442 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:48.314074    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"]
Sep 14 10:10:48.316110 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:48.315791    2581 scope.go:117] "RemoveContainer" containerID="e54897c4eeaf6e05711b3b697d01e0d39b32d6efa35ece18f0542cfdcf9b53aa"
Sep 14 10:10:48.319289 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:10:48.319201    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e54897c4eeaf6e05711b3b697d01e0d39b32d6efa35ece18f0542cfdcf9b53aa\": container with ID starting with e54897c4eeaf6e05711b3b697d01e0d39b32d6efa35ece18f0542cfdcf9b53aa not found: ID does not exist" containerID="e54897c4eeaf6e05711b3b697d01e0d39b32d6efa35ece18f0542cfdcf9b53aa"
Sep 14 10:10:48.319954 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:48.319896    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e54897c4eeaf6e05711b3b697d01e0d39b32d6efa35ece18f0542cfdcf9b53aa"} err="failed to get container status \"e54897c4eeaf6e05711b3b697d01e0d39b32d6efa35ece18f0542cfdcf9b53aa\": rpc error: code = NotFound desc = could not find container \"e54897c4eeaf6e05711b3b697d01e0d39b32d6efa35ece18f0542cfdcf9b53aa\": container with ID starting with e54897c4eeaf6e05711b3b697d01e0d39b32d6efa35ece18f0542cfdcf9b53aa not found: ID does not exist"
Sep 14 10:10:48.329304 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:48.329236    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-2901ec/distinct-2-w4-2901ec-kserve-5b7cb8b646-lmw6s"]
Sep 14 10:10:48.345821 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:48.345785    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"]
Sep 14 10:10:48.353334 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:48.353299    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-2901ec/premium-w4-2901ec-kserve-c488b59f4-z8f5j"]
Sep 14 10:10:48.656559 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:48.656475    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="190aceb5-32fc-4061-8c69-8e284c7591c9" path="/var/lib/kubelet/pods/190aceb5-32fc-4061-8c69-8e284c7591c9/volumes"
Sep 14 10:10:48.656946 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:48.656922    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="481dd875-3290-4ab0-8902-145f67b18dd7" path="/var/lib/kubelet/pods/481dd875-3290-4ab0-8902-145f67b18dd7/volumes"
Sep 14 10:10:50.685603 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:50.685562    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"]
Sep 14 10:10:50.686155 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:50.685801    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54" podUID="07aeea07-f338-495e-8ee3-58672f77b10b" containerName="istio-proxy" containerID="cri-o://f74e7b70ec4502aaaf5a26386269da5dc7982f069e37267840939f8b81a7e6e1" gracePeriod=30
Sep 14 10:10:55.949381 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:55.949312    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:10:56.007053 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.007018    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-workload-certs\") pod \"07aeea07-f338-495e-8ee3-58672f77b10b\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") "
Sep 14 10:10:56.007053 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.007063    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07aeea07-f338-495e-8ee3-58672f77b10b-istio-podinfo\") pod \"07aeea07-f338-495e-8ee3-58672f77b10b\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") "
Sep 14 10:10:56.007330 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.007112    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54vcj\" (UniqueName: \"kubernetes.io/projected/07aeea07-f338-495e-8ee3-58672f77b10b-kube-api-access-54vcj\") pod \"07aeea07-f338-495e-8ee3-58672f77b10b\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") "
Sep 14 10:10:56.007330 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.007158    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-workload-socket\") pod \"07aeea07-f338-495e-8ee3-58672f77b10b\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") "
Sep 14 10:10:56.007330 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.007205    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07aeea07-f338-495e-8ee3-58672f77b10b-istio-token\") pod \"07aeea07-f338-495e-8ee3-58672f77b10b\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") "
Sep 14 10:10:56.007330 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.007224    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-credential-socket\") pod \"07aeea07-f338-495e-8ee3-58672f77b10b\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") "
Sep 14 10:10:56.007330 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.007260    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07aeea07-f338-495e-8ee3-58672f77b10b-istiod-ca-cert\") pod \"07aeea07-f338-495e-8ee3-58672f77b10b\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") "
Sep 14 10:10:56.007330 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.007316    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "07aeea07-f338-495e-8ee3-58672f77b10b" (UID: "07aeea07-f338-495e-8ee3-58672f77b10b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:56.007623 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.007496    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "07aeea07-f338-495e-8ee3-58672f77b10b" (UID: "07aeea07-f338-495e-8ee3-58672f77b10b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:56.007623 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.007533    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "07aeea07-f338-495e-8ee3-58672f77b10b" (UID: "07aeea07-f338-495e-8ee3-58672f77b10b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:56.007761 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.007645    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-istio-envoy\") pod \"07aeea07-f338-495e-8ee3-58672f77b10b\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") "
Sep 14 10:10:56.007761 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.007671    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-istio-data\") pod \"07aeea07-f338-495e-8ee3-58672f77b10b\" (UID: \"07aeea07-f338-495e-8ee3-58672f77b10b\") "
Sep 14 10:10:56.007761 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.007743    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07aeea07-f338-495e-8ee3-58672f77b10b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "07aeea07-f338-495e-8ee3-58672f77b10b" (UID: "07aeea07-f338-495e-8ee3-58672f77b10b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:10:56.008037 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.008015    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-workload-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:56.008037 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.008038    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-workload-socket\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:56.008196 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.008051    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-credential-socket\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:56.008196 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.008048    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-istio-data" (OuterVolumeSpecName: "istio-data") pod "07aeea07-f338-495e-8ee3-58672f77b10b" (UID: "07aeea07-f338-495e-8ee3-58672f77b10b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:56.008196 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.008064    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07aeea07-f338-495e-8ee3-58672f77b10b-istiod-ca-cert\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:56.009610 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.009587    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "07aeea07-f338-495e-8ee3-58672f77b10b" (UID: "07aeea07-f338-495e-8ee3-58672f77b10b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 14 10:10:56.009700 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.009602    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07aeea07-f338-495e-8ee3-58672f77b10b-istio-token" (OuterVolumeSpecName: "istio-token") pod "07aeea07-f338-495e-8ee3-58672f77b10b" (UID: "07aeea07-f338-495e-8ee3-58672f77b10b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:10:56.009880 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.009861    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07aeea07-f338-495e-8ee3-58672f77b10b-kube-api-access-54vcj" (OuterVolumeSpecName: "kube-api-access-54vcj") pod "07aeea07-f338-495e-8ee3-58672f77b10b" (UID: "07aeea07-f338-495e-8ee3-58672f77b10b"). InnerVolumeSpecName "kube-api-access-54vcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:10:56.009945 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.009903    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07aeea07-f338-495e-8ee3-58672f77b10b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "07aeea07-f338-495e-8ee3-58672f77b10b" (UID: "07aeea07-f338-495e-8ee3-58672f77b10b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 14 10:10:56.109282 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.109240    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07aeea07-f338-495e-8ee3-58672f77b10b-istio-podinfo\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:56.109282 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.109276    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54vcj\" (UniqueName: \"kubernetes.io/projected/07aeea07-f338-495e-8ee3-58672f77b10b-kube-api-access-54vcj\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:56.109282 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.109289    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07aeea07-f338-495e-8ee3-58672f77b10b-istio-token\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:56.109521 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.109304    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-istio-envoy\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:56.109521 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.109314    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07aeea07-f338-495e-8ee3-58672f77b10b-istio-data\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:10:56.334438 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.334336    2581 generic.go:356] "Generic (PLEG): container finished" podID="07aeea07-f338-495e-8ee3-58672f77b10b" containerID="f74e7b70ec4502aaaf5a26386269da5dc7982f069e37267840939f8b81a7e6e1" exitCode=0
Sep 14 10:10:56.334438 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.334393    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"
Sep 14 10:10:56.334438 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.334414    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54" event={"ID":"07aeea07-f338-495e-8ee3-58672f77b10b","Type":"ContainerDied","Data":"f74e7b70ec4502aaaf5a26386269da5dc7982f069e37267840939f8b81a7e6e1"}
Sep 14 10:10:56.334746 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.334470    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54" event={"ID":"07aeea07-f338-495e-8ee3-58672f77b10b","Type":"ContainerDied","Data":"7f697281e406002a936327434d8a96483784ff55827ec21f0b6f9c27f3743325"}
Sep 14 10:10:56.334746 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.334493    2581 scope.go:117] "RemoveContainer" containerID="f74e7b70ec4502aaaf5a26386269da5dc7982f069e37267840939f8b81a7e6e1"
Sep 14 10:10:56.343928 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.343910    2581 scope.go:117] "RemoveContainer" containerID="56dd58fc9edc97f76307785da81823dce1e2e861d4ec22f3ca92787347d28070"
Sep 14 10:10:56.352947 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.352920    2581 scope.go:117] "RemoveContainer" containerID="f74e7b70ec4502aaaf5a26386269da5dc7982f069e37267840939f8b81a7e6e1"
Sep 14 10:10:56.353238 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:10:56.353221    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f74e7b70ec4502aaaf5a26386269da5dc7982f069e37267840939f8b81a7e6e1\": container with ID starting with f74e7b70ec4502aaaf5a26386269da5dc7982f069e37267840939f8b81a7e6e1 not found: ID does not exist" containerID="f74e7b70ec4502aaaf5a26386269da5dc7982f069e37267840939f8b81a7e6e1"
Sep 14 10:10:56.353292 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.353248    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f74e7b70ec4502aaaf5a26386269da5dc7982f069e37267840939f8b81a7e6e1"} err="failed to get container status \"f74e7b70ec4502aaaf5a26386269da5dc7982f069e37267840939f8b81a7e6e1\": rpc error: code = NotFound desc = could not find container \"f74e7b70ec4502aaaf5a26386269da5dc7982f069e37267840939f8b81a7e6e1\": container with ID starting with f74e7b70ec4502aaaf5a26386269da5dc7982f069e37267840939f8b81a7e6e1 not found: ID does not exist"
Sep 14 10:10:56.353292 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.353264    2581 scope.go:117] "RemoveContainer" containerID="56dd58fc9edc97f76307785da81823dce1e2e861d4ec22f3ca92787347d28070"
Sep 14 10:10:56.353549 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:10:56.353531    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56dd58fc9edc97f76307785da81823dce1e2e861d4ec22f3ca92787347d28070\": container with ID starting with 56dd58fc9edc97f76307785da81823dce1e2e861d4ec22f3ca92787347d28070 not found: ID does not exist" containerID="56dd58fc9edc97f76307785da81823dce1e2e861d4ec22f3ca92787347d28070"
Sep 14 10:10:56.353593 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.353553    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56dd58fc9edc97f76307785da81823dce1e2e861d4ec22f3ca92787347d28070"} err="failed to get container status \"56dd58fc9edc97f76307785da81823dce1e2e861d4ec22f3ca92787347d28070\": rpc error: code = NotFound desc = could not find container \"56dd58fc9edc97f76307785da81823dce1e2e861d4ec22f3ca92787347d28070\": container with ID starting with 56dd58fc9edc97f76307785da81823dce1e2e861d4ec22f3ca92787347d28070 not found: ID does not exist"
Sep 14 10:10:56.360835 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.360793    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"]
Sep 14 10:10:56.365350 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.365322    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8fd006-openshift-default-859794cc5d-jpt54"]
Sep 14 10:10:56.656021 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:10:56.655938    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07aeea07-f338-495e-8ee3-58672f77b10b" path="/var/lib/kubelet/pods/07aeea07-f338-495e-8ee3-58672f77b10b/volumes"
Sep 14 10:11:00.676745 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:00.676695    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:11:01.646498 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:01.646407    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"]
Sep 14 10:11:01.646903 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:01.646860    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp" podUID="f152aebe-c4c6-4b32-b72c-f0d96c3199b0" containerName="maas-api" containerID="cri-o://ea1c1a3507bc56609f610b5f865bbb5f7cf5e41246515a19555e1cf749727d31" gracePeriod=30
Sep 14 10:11:01.776732 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:01.776663    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp" podUID="f152aebe-c4c6-4b32-b72c-f0d96c3199b0" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.62:8443/health\": dial tcp 10.133.0.62:8443: connect: connection refused"
Sep 14 10:11:01.916305 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:01.916273    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"
Sep 14 10:11:01.973631 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:01.973592    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpjdg\" (UniqueName: \"kubernetes.io/projected/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-kube-api-access-cpjdg\") pod \"f152aebe-c4c6-4b32-b72c-f0d96c3199b0\" (UID: \"f152aebe-c4c6-4b32-b72c-f0d96c3199b0\") "
Sep 14 10:11:01.973815 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:01.973656    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-metrics-certs\") pod \"f152aebe-c4c6-4b32-b72c-f0d96c3199b0\" (UID: \"f152aebe-c4c6-4b32-b72c-f0d96c3199b0\") "
Sep 14 10:11:01.973815 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:01.973779    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-openshift-service-ca\") pod \"f152aebe-c4c6-4b32-b72c-f0d96c3199b0\" (UID: \"f152aebe-c4c6-4b32-b72c-f0d96c3199b0\") "
Sep 14 10:11:01.973815 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:01.973809    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-maas-api-tls\") pod \"f152aebe-c4c6-4b32-b72c-f0d96c3199b0\" (UID: \"f152aebe-c4c6-4b32-b72c-f0d96c3199b0\") "
Sep 14 10:11:01.974224 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:01.974193    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f152aebe-c4c6-4b32-b72c-f0d96c3199b0" (UID: "f152aebe-c4c6-4b32-b72c-f0d96c3199b0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:11:01.975989 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:01.975954    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-kube-api-access-cpjdg" (OuterVolumeSpecName: "kube-api-access-cpjdg") pod "f152aebe-c4c6-4b32-b72c-f0d96c3199b0" (UID: "f152aebe-c4c6-4b32-b72c-f0d96c3199b0"). InnerVolumeSpecName "kube-api-access-cpjdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:11:01.975989 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:01.975969    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f152aebe-c4c6-4b32-b72c-f0d96c3199b0" (UID: "f152aebe-c4c6-4b32-b72c-f0d96c3199b0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:11:01.976199 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:01.976057    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f152aebe-c4c6-4b32-b72c-f0d96c3199b0" (UID: "f152aebe-c4c6-4b32-b72c-f0d96c3199b0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:11:02.075127 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:02.075088    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-maas-api-tls\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:11:02.075127 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:02.075123    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpjdg\" (UniqueName: \"kubernetes.io/projected/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-kube-api-access-cpjdg\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:11:02.075127 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:02.075134    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-metrics-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:11:02.075377 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:02.075143    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f152aebe-c4c6-4b32-b72c-f0d96c3199b0-openshift-service-ca\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:11:02.371442 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:02.371406    2581 generic.go:356] "Generic (PLEG): container finished" podID="f152aebe-c4c6-4b32-b72c-f0d96c3199b0" containerID="ea1c1a3507bc56609f610b5f865bbb5f7cf5e41246515a19555e1cf749727d31" exitCode=0
Sep 14 10:11:02.371633 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:02.371458    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"
Sep 14 10:11:02.371633 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:02.371475    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp" event={"ID":"f152aebe-c4c6-4b32-b72c-f0d96c3199b0","Type":"ContainerDied","Data":"ea1c1a3507bc56609f610b5f865bbb5f7cf5e41246515a19555e1cf749727d31"}
Sep 14 10:11:02.371633 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:02.371517    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp" event={"ID":"f152aebe-c4c6-4b32-b72c-f0d96c3199b0","Type":"ContainerDied","Data":"b0b61c8e8eef4987422c633c386b525cb6efde23e5c4e9b2077fedfc0d7c0654"}
Sep 14 10:11:02.371633 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:02.371543    2581 scope.go:117] "RemoveContainer" containerID="ea1c1a3507bc56609f610b5f865bbb5f7cf5e41246515a19555e1cf749727d31"
Sep 14 10:11:02.381885 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:02.381866    2581 scope.go:117] "RemoveContainer" containerID="ea1c1a3507bc56609f610b5f865bbb5f7cf5e41246515a19555e1cf749727d31"
Sep 14 10:11:02.382205 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:11:02.382184    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea1c1a3507bc56609f610b5f865bbb5f7cf5e41246515a19555e1cf749727d31\": container with ID starting with ea1c1a3507bc56609f610b5f865bbb5f7cf5e41246515a19555e1cf749727d31 not found: ID does not exist" containerID="ea1c1a3507bc56609f610b5f865bbb5f7cf5e41246515a19555e1cf749727d31"
Sep 14 10:11:02.382281 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:02.382213    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea1c1a3507bc56609f610b5f865bbb5f7cf5e41246515a19555e1cf749727d31"} err="failed to get container status \"ea1c1a3507bc56609f610b5f865bbb5f7cf5e41246515a19555e1cf749727d31\": rpc error: code = NotFound desc = could not find container \"ea1c1a3507bc56609f610b5f865bbb5f7cf5e41246515a19555e1cf749727d31\": container with ID starting with ea1c1a3507bc56609f610b5f865bbb5f7cf5e41246515a19555e1cf749727d31 not found: ID does not exist"
Sep 14 10:11:02.395574 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:02.395536    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"]
Sep 14 10:11:02.399692 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:02.399659    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-9e19b7-75559dfdd7-5kpqp"]
Sep 14 10:11:02.656428 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:02.656343    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f152aebe-c4c6-4b32-b72c-f0d96c3199b0" path="/var/lib/kubelet/pods/f152aebe-c4c6-4b32-b72c-f0d96c3199b0/volumes"
Sep 14 10:11:13.869664 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:13.869628    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:11:25.580763 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:25.580700    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:11:36.104629 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:36.104532    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:11:47.480780 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:47.480740    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:11:57.780111 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:11:57.780074    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:12:17.182650 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:12:17.182613    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:12:30.781547 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:12:30.781506    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:12:43.479287 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:12:43.479248    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:12:57.481926 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:12:57.481843    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:13:08.204749 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:13:08.204615    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:13:25.882041 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:13:25.881996    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:13:41.669350 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:13:41.669308    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:13:52.074976 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:13:52.074932    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:14:04.605772 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.605733    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b"]
Sep 14 10:14:04.606148 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606134    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07aeea07-f338-495e-8ee3-58672f77b10b" containerName="istio-proxy"
Sep 14 10:14:04.606148 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606148    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="07aeea07-f338-495e-8ee3-58672f77b10b" containerName="istio-proxy"
Sep 14 10:14:04.606225 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606158    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="481dd875-3290-4ab0-8902-145f67b18dd7" containerName="main"
Sep 14 10:14:04.606225 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606165    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="481dd875-3290-4ab0-8902-145f67b18dd7" containerName="main"
Sep 14 10:14:04.606225 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606172    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="495ef1e1-7c58-4b68-831d-cb515d1e9112" containerName="istio-proxy"
Sep 14 10:14:04.606225 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606177    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="495ef1e1-7c58-4b68-831d-cb515d1e9112" containerName="istio-proxy"
Sep 14 10:14:04.606225 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606192    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="495ef1e1-7c58-4b68-831d-cb515d1e9112" containerName="istio-proxy"
Sep 14 10:14:04.606225 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606197    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="495ef1e1-7c58-4b68-831d-cb515d1e9112" containerName="istio-proxy"
Sep 14 10:14:04.606225 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606204    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa730b5e-ba9e-49e7-b802-2fa93257a4ce" containerName="payload-processing"
Sep 14 10:14:04.606225 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606210    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa730b5e-ba9e-49e7-b802-2fa93257a4ce" containerName="payload-processing"
Sep 14 10:14:04.606225 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606217    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5197ca13-8f47-40d9-a297-fb2ab1f02899" containerName="maas-api"
Sep 14 10:14:04.606225 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606223    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5197ca13-8f47-40d9-a297-fb2ab1f02899" containerName="maas-api"
Sep 14 10:14:04.606225 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606229    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="190aceb5-32fc-4061-8c69-8e284c7591c9" containerName="main"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606234    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="190aceb5-32fc-4061-8c69-8e284c7591c9" containerName="main"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606240    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06f4ad76-ff24-47e5-a41f-6d022e7ae15d" containerName="main"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606245    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="06f4ad76-ff24-47e5-a41f-6d022e7ae15d" containerName="main"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606253    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="674dc0c9-b738-4844-8b73-25381039ac2f" containerName="main"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606257    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="674dc0c9-b738-4844-8b73-25381039ac2f" containerName="main"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606263    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23787b52-fe29-4f2f-8b65-7b051874fe3d" containerName="payload-pre-processing"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606268    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="23787b52-fe29-4f2f-8b65-7b051874fe3d" containerName="payload-pre-processing"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606277    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d53e8b31-b1b9-4c4c-99b2-8212c9078b4d" containerName="maas-api"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606281    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d53e8b31-b1b9-4c4c-99b2-8212c9078b4d" containerName="maas-api"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606288    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f152aebe-c4c6-4b32-b72c-f0d96c3199b0" containerName="maas-api"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606292    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f152aebe-c4c6-4b32-b72c-f0d96c3199b0" containerName="maas-api"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606348    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="674dc0c9-b738-4844-8b73-25381039ac2f" containerName="main"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606357    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="495ef1e1-7c58-4b68-831d-cb515d1e9112" containerName="istio-proxy"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606363    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa730b5e-ba9e-49e7-b802-2fa93257a4ce" containerName="payload-processing"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606368    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="190aceb5-32fc-4061-8c69-8e284c7591c9" containerName="main"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606373    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f152aebe-c4c6-4b32-b72c-f0d96c3199b0" containerName="maas-api"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606378    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5197ca13-8f47-40d9-a297-fb2ab1f02899" containerName="maas-api"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606382    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="07aeea07-f338-495e-8ee3-58672f77b10b" containerName="istio-proxy"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606386    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="481dd875-3290-4ab0-8902-145f67b18dd7" containerName="main"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606392    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="07aeea07-f338-495e-8ee3-58672f77b10b" containerName="istio-proxy"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606397    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="23787b52-fe29-4f2f-8b65-7b051874fe3d" containerName="payload-pre-processing"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606403    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d53e8b31-b1b9-4c4c-99b2-8212c9078b4d" containerName="maas-api"
Sep 14 10:14:04.606549 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.606409    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="06f4ad76-ff24-47e5-a41f-6d022e7ae15d" containerName="main"
Sep 14 10:14:04.609615 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.609597    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b"
Sep 14 10:14:04.612652 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.612630    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-78742b-dockercfg-tc4gg\""
Sep 14 10:14:04.612791 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.612630    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-78742b\""
Sep 14 10:14:04.618994 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.618971    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b"]
Sep 14 10:14:04.697122 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.697074    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15ba66ed-f56f-456e-ac16-e55ca72a8304-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b\" (UID: \"15ba66ed-f56f-456e-ac16-e55ca72a8304\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b"
Sep 14 10:14:04.697311 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.697174    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q54vs\" (UniqueName: \"kubernetes.io/projected/15ba66ed-f56f-456e-ac16-e55ca72a8304-kube-api-access-q54vs\") pod \"payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b\" (UID: \"15ba66ed-f56f-456e-ac16-e55ca72a8304\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b"
Sep 14 10:14:04.798000 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.797959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q54vs\" (UniqueName: \"kubernetes.io/projected/15ba66ed-f56f-456e-ac16-e55ca72a8304-kube-api-access-q54vs\") pod \"payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b\" (UID: \"15ba66ed-f56f-456e-ac16-e55ca72a8304\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b"
Sep 14 10:14:04.798179 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.798099    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15ba66ed-f56f-456e-ac16-e55ca72a8304-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b\" (UID: \"15ba66ed-f56f-456e-ac16-e55ca72a8304\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b"
Sep 14 10:14:04.798891 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.798866    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15ba66ed-f56f-456e-ac16-e55ca72a8304-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b\" (UID: \"15ba66ed-f56f-456e-ac16-e55ca72a8304\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b"
Sep 14 10:14:04.806247 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.806221    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q54vs\" (UniqueName: \"kubernetes.io/projected/15ba66ed-f56f-456e-ac16-e55ca72a8304-kube-api-access-q54vs\") pod \"payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b\" (UID: \"15ba66ed-f56f-456e-ac16-e55ca72a8304\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b"
Sep 14 10:14:04.921554 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:04.921476    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b"
Sep 14 10:14:05.197751 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:05.197720    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b"]
Sep 14 10:14:05.200419 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:14:05.200384    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ba66ed_f56f_456e_ac16_e55ca72a8304.slice/crio-5a0759339e8797765d365532b7510936c243a5f1935142ede4dd2ff05230fd27 WatchSource:0}: Error finding container 5a0759339e8797765d365532b7510936c243a5f1935142ede4dd2ff05230fd27: Status 404 returned error can't find the container with id 5a0759339e8797765d365532b7510936c243a5f1935142ede4dd2ff05230fd27
Sep 14 10:14:05.326475 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:05.326353    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b" event={"ID":"15ba66ed-f56f-456e-ac16-e55ca72a8304","Type":"ContainerStarted","Data":"820d5c275fe58fd5d41ac7bd33aeb3826c158275c1c35fec556381416263addf"}
Sep 14 10:14:05.326905 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:05.326527    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b" event={"ID":"15ba66ed-f56f-456e-ac16-e55ca72a8304","Type":"ContainerStarted","Data":"5a0759339e8797765d365532b7510936c243a5f1935142ede4dd2ff05230fd27"}
Sep 14 10:14:05.326905 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:05.326719    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b"
Sep 14 10:14:05.346343 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:05.346207    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b" podStartSLOduration=1.34615776 podStartE2EDuration="1.34615776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:14:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:14:05.344627211 +0000 UTC m=+1861.202859569" watchObservedRunningTime="2026-09-14 10:14:05.34615776 +0000 UTC m=+1861.204390117"
Sep 14 10:14:06.872825 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:06.872774    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:14:16.334945 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:16.334900    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b"
Sep 14 10:14:33.971062 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:33.970969    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"]
Sep 14 10:14:33.973663 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:33.971486    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07aeea07-f338-495e-8ee3-58672f77b10b" containerName="istio-proxy"
Sep 14 10:14:33.973663 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:33.971501    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="07aeea07-f338-495e-8ee3-58672f77b10b" containerName="istio-proxy"
Sep 14 10:14:33.973663 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:33.971585    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="495ef1e1-7c58-4b68-831d-cb515d1e9112" containerName="istio-proxy"
Sep 14 10:14:33.974595 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:33.974575    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"
Sep 14 10:14:33.977484 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:33.977459    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-2c2a39-serving-cert\""
Sep 14 10:14:33.991906 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:33.991873    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"]
Sep 14 10:14:34.077349 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.077314    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95c1914d-437d-42c0-a97c-9a9f1edd00a4-metrics-certs\") pod \"maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9\" (UID: \"95c1914d-437d-42c0-a97c-9a9f1edd00a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"
Sep 14 10:14:34.077550 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.077401    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7wwf\" (UniqueName: \"kubernetes.io/projected/95c1914d-437d-42c0-a97c-9a9f1edd00a4-kube-api-access-m7wwf\") pod \"maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9\" (UID: \"95c1914d-437d-42c0-a97c-9a9f1edd00a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"
Sep 14 10:14:34.077550 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.077430    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95c1914d-437d-42c0-a97c-9a9f1edd00a4-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9\" (UID: \"95c1914d-437d-42c0-a97c-9a9f1edd00a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"
Sep 14 10:14:34.077550 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.077512    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95c1914d-437d-42c0-a97c-9a9f1edd00a4-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9\" (UID: \"95c1914d-437d-42c0-a97c-9a9f1edd00a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"
Sep 14 10:14:34.178489 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.178457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95c1914d-437d-42c0-a97c-9a9f1edd00a4-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9\" (UID: \"95c1914d-437d-42c0-a97c-9a9f1edd00a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"
Sep 14 10:14:34.178681 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.178515    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95c1914d-437d-42c0-a97c-9a9f1edd00a4-metrics-certs\") pod \"maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9\" (UID: \"95c1914d-437d-42c0-a97c-9a9f1edd00a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"
Sep 14 10:14:34.178681 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.178545    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7wwf\" (UniqueName: \"kubernetes.io/projected/95c1914d-437d-42c0-a97c-9a9f1edd00a4-kube-api-access-m7wwf\") pod \"maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9\" (UID: \"95c1914d-437d-42c0-a97c-9a9f1edd00a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"
Sep 14 10:14:34.178681 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.178564    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95c1914d-437d-42c0-a97c-9a9f1edd00a4-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9\" (UID: \"95c1914d-437d-42c0-a97c-9a9f1edd00a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"
Sep 14 10:14:34.178681 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:14:34.178608    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-serving-cert: secret "maas-api-e2e-ipp-b-2c2a39-serving-cert" not found
Sep 14 10:14:34.178931 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:14:34.178689    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95c1914d-437d-42c0-a97c-9a9f1edd00a4-maas-api-tls podName:95c1914d-437d-42c0-a97c-9a9f1edd00a4 nodeName:}" failed. No retries permitted until 2026-09-14 10:14:34.678667282 +0000 UTC m=+1890.536899636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/95c1914d-437d-42c0-a97c-9a9f1edd00a4-maas-api-tls") pod "maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9" (UID: "95c1914d-437d-42c0-a97c-9a9f1edd00a4") : secret "maas-api-e2e-ipp-b-2c2a39-serving-cert" not found
Sep 14 10:14:34.179304 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.179286    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95c1914d-437d-42c0-a97c-9a9f1edd00a4-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9\" (UID: \"95c1914d-437d-42c0-a97c-9a9f1edd00a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"
Sep 14 10:14:34.181127 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.181104    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95c1914d-437d-42c0-a97c-9a9f1edd00a4-metrics-certs\") pod \"maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9\" (UID: \"95c1914d-437d-42c0-a97c-9a9f1edd00a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"
Sep 14 10:14:34.190118 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.190091    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7wwf\" (UniqueName: \"kubernetes.io/projected/95c1914d-437d-42c0-a97c-9a9f1edd00a4-kube-api-access-m7wwf\") pod \"maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9\" (UID: \"95c1914d-437d-42c0-a97c-9a9f1edd00a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"
Sep 14 10:14:34.682571 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.682537    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95c1914d-437d-42c0-a97c-9a9f1edd00a4-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9\" (UID: \"95c1914d-437d-42c0-a97c-9a9f1edd00a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"
Sep 14 10:14:34.684942 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.684911    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95c1914d-437d-42c0-a97c-9a9f1edd00a4-maas-api-tls\") pod \"maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9\" (UID: \"95c1914d-437d-42c0-a97c-9a9f1edd00a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"
Sep 14 10:14:34.766955 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.766913    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q"]
Sep 14 10:14:34.770670 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.770649    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q"
Sep 14 10:14:34.773752 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.773733    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-2c2a39-dockercfg-478qj\""
Sep 14 10:14:34.773861 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.773776    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-2c2a39\""
Sep 14 10:14:34.781678 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.781652    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q"]
Sep 14 10:14:34.884614 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.884578    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a5bb819-9a1b-48ee-a656-db4081a8fbca-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q\" (UID: \"7a5bb819-9a1b-48ee-a656-db4081a8fbca\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q"
Sep 14 10:14:34.884819 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.884636    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqjcj\" (UniqueName: \"kubernetes.io/projected/7a5bb819-9a1b-48ee-a656-db4081a8fbca-kube-api-access-wqjcj\") pod \"payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q\" (UID: \"7a5bb819-9a1b-48ee-a656-db4081a8fbca\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q"
Sep 14 10:14:34.884891 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.884813    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"
Sep 14 10:14:34.986166 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.986124    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a5bb819-9a1b-48ee-a656-db4081a8fbca-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q\" (UID: \"7a5bb819-9a1b-48ee-a656-db4081a8fbca\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q"
Sep 14 10:14:34.986635 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.986179    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqjcj\" (UniqueName: \"kubernetes.io/projected/7a5bb819-9a1b-48ee-a656-db4081a8fbca-kube-api-access-wqjcj\") pod \"payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q\" (UID: \"7a5bb819-9a1b-48ee-a656-db4081a8fbca\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q"
Sep 14 10:14:34.987035 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.987007    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a5bb819-9a1b-48ee-a656-db4081a8fbca-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q\" (UID: \"7a5bb819-9a1b-48ee-a656-db4081a8fbca\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q"
Sep 14 10:14:34.995079 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:34.995047    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqjcj\" (UniqueName: \"kubernetes.io/projected/7a5bb819-9a1b-48ee-a656-db4081a8fbca-kube-api-access-wqjcj\") pod \"payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q\" (UID: \"7a5bb819-9a1b-48ee-a656-db4081a8fbca\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q"
Sep 14 10:14:35.082640 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:35.082599    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q"
Sep 14 10:14:35.166601 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:35.166574    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"]
Sep 14 10:14:35.169311 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:14:35.169280    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95c1914d_437d_42c0_a97c_9a9f1edd00a4.slice/crio-5d9e11aaa851280170d7fc78e21822f9c413179664aa94029fcbb4f3adda0b7a WatchSource:0}: Error finding container 5d9e11aaa851280170d7fc78e21822f9c413179664aa94029fcbb4f3adda0b7a: Status 404 returned error can't find the container with id 5d9e11aaa851280170d7fc78e21822f9c413179664aa94029fcbb4f3adda0b7a
Sep 14 10:14:35.171063 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:35.171039    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 10:14:35.360980 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:35.360954    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q"]
Sep 14 10:14:35.362950 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:14:35.362921    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a5bb819_9a1b_48ee_a656_db4081a8fbca.slice/crio-e065b101946c7093fe4761438e03e299d430390f8624a2df6e200007b117d3ce WatchSource:0}: Error finding container e065b101946c7093fe4761438e03e299d430390f8624a2df6e200007b117d3ce: Status 404 returned error can't find the container with id e065b101946c7093fe4761438e03e299d430390f8624a2df6e200007b117d3ce
Sep 14 10:14:35.484556 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:35.484517    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9" event={"ID":"95c1914d-437d-42c0-a97c-9a9f1edd00a4","Type":"ContainerStarted","Data":"5d9e11aaa851280170d7fc78e21822f9c413179664aa94029fcbb4f3adda0b7a"}
Sep 14 10:14:35.486379 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:35.486354    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q" event={"ID":"7a5bb819-9a1b-48ee-a656-db4081a8fbca","Type":"ContainerStarted","Data":"59449a7c4407c231eb2c56ac52b2cf4946c15e6e07c3697117e733a50291f251"}
Sep 14 10:14:35.486530 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:35.486395    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q" event={"ID":"7a5bb819-9a1b-48ee-a656-db4081a8fbca","Type":"ContainerStarted","Data":"e065b101946c7093fe4761438e03e299d430390f8624a2df6e200007b117d3ce"}
Sep 14 10:14:35.486594 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:35.486539    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q"
Sep 14 10:14:35.505367 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:35.505303    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q" podStartSLOduration=1.505286014 podStartE2EDuration="1.505286014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:14:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:14:35.502834322 +0000 UTC m=+1891.361066670" watchObservedRunningTime="2026-09-14 10:14:35.505286014 +0000 UTC m=+1891.363518371"
Sep 14 10:14:36.494669 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:36.494627    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9" event={"ID":"95c1914d-437d-42c0-a97c-9a9f1edd00a4","Type":"ContainerStarted","Data":"8ea5427116e3b15010c018c5692a548cbf1dc7fed0b64e4f0b6dc833026681e0"}
Sep 14 10:14:36.495210 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:36.494977    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"
Sep 14 10:14:36.516830 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:36.516751    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9" podStartSLOduration=3.156856183 podStartE2EDuration="3.516726939s" totalImagesPullingTime="359.870756ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:14:36.51401875 +0000 UTC m=+1892.372251107" watchObservedRunningTime="2026-09-14 10:14:36.516726939 +0000 UTC m=+1892.374959293"
Sep 14 10:14:38.983273 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:38.983231    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:14:42.504986 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:42.504947    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"
Sep 14 10:14:46.497379 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:14:46.497341    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q"
Sep 14 10:15:01.284649 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:01.284606    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-jtl9g_e9fb2c13-a823-4d31-8633-e79a2affba2d/payload-processing/0.log"
Sep 14 10:15:01.406967 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:01.406934    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q_7a5bb819-9a1b-48ee-a656-db4081a8fbca/payload-processing/0.log"
Sep 14 10:15:11.776506 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:11.776464    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:15:25.820961 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:25.820915    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:15:32.206647 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:32.206613    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-jtl9g_e9fb2c13-a823-4d31-8633-e79a2affba2d/payload-processing/0.log"
Sep 14 10:15:32.331239 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:32.331202    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q_7a5bb819-9a1b-48ee-a656-db4081a8fbca/payload-processing/0.log"
Sep 14 10:15:40.207334 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:40.207285    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8"]
Sep 14 10:15:40.211187 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:40.211160    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8"
Sep 14 10:15:40.213906 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:40.213881    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-51f250\""
Sep 14 10:15:40.222904 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:40.222875    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8"]
Sep 14 10:15:40.315147 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:40.315103    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4ftl\" (UniqueName: \"kubernetes.io/projected/d3505bad-0ef1-44e5-89d1-1366b42110ae-kube-api-access-n4ftl\") pod \"payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8\" (UID: \"d3505bad-0ef1-44e5-89d1-1366b42110ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8"
Sep 14 10:15:40.315337 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:40.315163    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3505bad-0ef1-44e5-89d1-1366b42110ae-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8\" (UID: \"d3505bad-0ef1-44e5-89d1-1366b42110ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8"
Sep 14 10:15:40.415764 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:40.415703    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4ftl\" (UniqueName: \"kubernetes.io/projected/d3505bad-0ef1-44e5-89d1-1366b42110ae-kube-api-access-n4ftl\") pod \"payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8\" (UID: \"d3505bad-0ef1-44e5-89d1-1366b42110ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8"
Sep 14 10:15:40.415764 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:40.415765    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3505bad-0ef1-44e5-89d1-1366b42110ae-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8\" (UID: \"d3505bad-0ef1-44e5-89d1-1366b42110ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8"
Sep 14 10:15:40.416492 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:40.416469    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3505bad-0ef1-44e5-89d1-1366b42110ae-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8\" (UID: \"d3505bad-0ef1-44e5-89d1-1366b42110ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8"
Sep 14 10:15:40.424408 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:40.424382    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4ftl\" (UniqueName: \"kubernetes.io/projected/d3505bad-0ef1-44e5-89d1-1366b42110ae-kube-api-access-n4ftl\") pod \"payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8\" (UID: \"d3505bad-0ef1-44e5-89d1-1366b42110ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8"
Sep 14 10:15:40.522823 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:40.522736    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8"
Sep 14 10:15:40.807073 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:40.805058    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8"]
Sep 14 10:15:40.810475 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:15:40.810436    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3505bad_0ef1_44e5_89d1_1366b42110ae.slice/crio-2d9d3387c82bb2984dffcddbe6a0fefb05aef652bdb2845f39437a8c4f06dceb WatchSource:0}: Error finding container 2d9d3387c82bb2984dffcddbe6a0fefb05aef652bdb2845f39437a8c4f06dceb: Status 404 returned error can't find the container with id 2d9d3387c82bb2984dffcddbe6a0fefb05aef652bdb2845f39437a8c4f06dceb
Sep 14 10:15:40.835950 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:40.835912    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8" event={"ID":"d3505bad-0ef1-44e5-89d1-1366b42110ae","Type":"ContainerStarted","Data":"2d9d3387c82bb2984dffcddbe6a0fefb05aef652bdb2845f39437a8c4f06dceb"}
Sep 14 10:15:41.842673 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:41.842636    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8" event={"ID":"d3505bad-0ef1-44e5-89d1-1366b42110ae","Type":"ContainerStarted","Data":"768635862a07e7807c8a8809bb09f142c82c52c74f1eb12ddf1c2b78dfe9f150"}
Sep 14 10:15:41.843084 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:41.842744    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8"
Sep 14 10:15:41.861768 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:41.861693    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8" podStartSLOduration=1.86167663 podStartE2EDuration="1.86167663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:15:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:15:41.860455587 +0000 UTC m=+1957.718687944" watchObservedRunningTime="2026-09-14 10:15:41.86167663 +0000 UTC m=+1957.719908986"
Sep 14 10:15:45.073548 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:45.073505    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:15:52.850150 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:15:52.850120    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8"
Sep 14 10:16:04.928743 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:04.928647    2581 scope.go:117] "RemoveContainer" containerID="1a128cf921d1fcbe309835e8201858f2349dd4e7460933dbe9d6391517d89a9b"
Sep 14 10:16:17.916007 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:17.915969    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8"]
Sep 14 10:16:17.916580 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:17.916193    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8" podUID="d3505bad-0ef1-44e5-89d1-1366b42110ae" containerName="payload-pre-processing" containerID="cri-o://768635862a07e7807c8a8809bb09f142c82c52c74f1eb12ddf1c2b78dfe9f150" gracePeriod=30
Sep 14 10:16:18.039624 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:18.039581    2581 generic.go:356] "Generic (PLEG): container finished" podID="d3505bad-0ef1-44e5-89d1-1366b42110ae" containerID="768635862a07e7807c8a8809bb09f142c82c52c74f1eb12ddf1c2b78dfe9f150" exitCode=0
Sep 14 10:16:18.039786 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:18.039654    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8" event={"ID":"d3505bad-0ef1-44e5-89d1-1366b42110ae","Type":"ContainerDied","Data":"768635862a07e7807c8a8809bb09f142c82c52c74f1eb12ddf1c2b78dfe9f150"}
Sep 14 10:16:18.177435 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:18.177364    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8"
Sep 14 10:16:18.278390 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:18.278344    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3505bad-0ef1-44e5-89d1-1366b42110ae-plugins-config-volume\") pod \"d3505bad-0ef1-44e5-89d1-1366b42110ae\" (UID: \"d3505bad-0ef1-44e5-89d1-1366b42110ae\") "
Sep 14 10:16:18.278605 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:18.278511    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4ftl\" (UniqueName: \"kubernetes.io/projected/d3505bad-0ef1-44e5-89d1-1366b42110ae-kube-api-access-n4ftl\") pod \"d3505bad-0ef1-44e5-89d1-1366b42110ae\" (UID: \"d3505bad-0ef1-44e5-89d1-1366b42110ae\") "
Sep 14 10:16:18.278851 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:18.278824    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3505bad-0ef1-44e5-89d1-1366b42110ae-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d3505bad-0ef1-44e5-89d1-1366b42110ae" (UID: "d3505bad-0ef1-44e5-89d1-1366b42110ae"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:16:18.280589 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:18.280564    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3505bad-0ef1-44e5-89d1-1366b42110ae-kube-api-access-n4ftl" (OuterVolumeSpecName: "kube-api-access-n4ftl") pod "d3505bad-0ef1-44e5-89d1-1366b42110ae" (UID: "d3505bad-0ef1-44e5-89d1-1366b42110ae"). InnerVolumeSpecName "kube-api-access-n4ftl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:16:18.379992 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:18.379949    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4ftl\" (UniqueName: \"kubernetes.io/projected/d3505bad-0ef1-44e5-89d1-1366b42110ae-kube-api-access-n4ftl\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:16:18.379992 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:18.379981    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3505bad-0ef1-44e5-89d1-1366b42110ae-plugins-config-volume\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:16:19.045914 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:19.045869    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8" event={"ID":"d3505bad-0ef1-44e5-89d1-1366b42110ae","Type":"ContainerDied","Data":"2d9d3387c82bb2984dffcddbe6a0fefb05aef652bdb2845f39437a8c4f06dceb"}
Sep 14 10:16:19.046391 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:19.045943    2581 scope.go:117] "RemoveContainer" containerID="768635862a07e7807c8a8809bb09f142c82c52c74f1eb12ddf1c2b78dfe9f150"
Sep 14 10:16:19.046391 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:19.045882    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8"
Sep 14 10:16:19.099223 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:19.099181    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8"]
Sep 14 10:16:19.121920 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:19.121887    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-51f250-69d56846bb-9t6c8"]
Sep 14 10:16:20.656398 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:20.656366    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3505bad-0ef1-44e5-89d1-1366b42110ae" path="/var/lib/kubelet/pods/d3505bad-0ef1-44e5-89d1-1366b42110ae/volumes"
Sep 14 10:16:22.279242 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:22.279188    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:16:42.903257 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:42.903221    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:16:45.577940 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:45.577904    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b"]
Sep 14 10:16:45.578355 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:45.578130    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b" podUID="15ba66ed-f56f-456e-ac16-e55ca72a8304" containerName="payload-pre-processing" containerID="cri-o://820d5c275fe58fd5d41ac7bd33aeb3826c158275c1c35fec556381416263addf" gracePeriod=30
Sep 14 10:16:45.861927 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:45.861901    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b"
Sep 14 10:16:45.949001 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:45.948961    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q54vs\" (UniqueName: \"kubernetes.io/projected/15ba66ed-f56f-456e-ac16-e55ca72a8304-kube-api-access-q54vs\") pod \"15ba66ed-f56f-456e-ac16-e55ca72a8304\" (UID: \"15ba66ed-f56f-456e-ac16-e55ca72a8304\") "
Sep 14 10:16:45.949220 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:45.949072    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15ba66ed-f56f-456e-ac16-e55ca72a8304-plugins-config-volume\") pod \"15ba66ed-f56f-456e-ac16-e55ca72a8304\" (UID: \"15ba66ed-f56f-456e-ac16-e55ca72a8304\") "
Sep 14 10:16:45.949626 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:45.949593    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15ba66ed-f56f-456e-ac16-e55ca72a8304-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "15ba66ed-f56f-456e-ac16-e55ca72a8304" (UID: "15ba66ed-f56f-456e-ac16-e55ca72a8304"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:16:45.951160 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:45.951130    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15ba66ed-f56f-456e-ac16-e55ca72a8304-kube-api-access-q54vs" (OuterVolumeSpecName: "kube-api-access-q54vs") pod "15ba66ed-f56f-456e-ac16-e55ca72a8304" (UID: "15ba66ed-f56f-456e-ac16-e55ca72a8304"). InnerVolumeSpecName "kube-api-access-q54vs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:16:46.050162 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:46.050120    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15ba66ed-f56f-456e-ac16-e55ca72a8304-plugins-config-volume\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:16:46.050162 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:46.050154    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q54vs\" (UniqueName: \"kubernetes.io/projected/15ba66ed-f56f-456e-ac16-e55ca72a8304-kube-api-access-q54vs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:16:46.188197 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:46.188158    2581 generic.go:356] "Generic (PLEG): container finished" podID="15ba66ed-f56f-456e-ac16-e55ca72a8304" containerID="820d5c275fe58fd5d41ac7bd33aeb3826c158275c1c35fec556381416263addf" exitCode=0
Sep 14 10:16:46.188197 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:46.188207    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b"
Sep 14 10:16:46.188429 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:46.188248    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b" event={"ID":"15ba66ed-f56f-456e-ac16-e55ca72a8304","Type":"ContainerDied","Data":"820d5c275fe58fd5d41ac7bd33aeb3826c158275c1c35fec556381416263addf"}
Sep 14 10:16:46.188429 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:46.188308    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b" event={"ID":"15ba66ed-f56f-456e-ac16-e55ca72a8304","Type":"ContainerDied","Data":"5a0759339e8797765d365532b7510936c243a5f1935142ede4dd2ff05230fd27"}
Sep 14 10:16:46.188429 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:46.188331    2581 scope.go:117] "RemoveContainer" containerID="820d5c275fe58fd5d41ac7bd33aeb3826c158275c1c35fec556381416263addf"
Sep 14 10:16:46.201864 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:46.201838    2581 scope.go:117] "RemoveContainer" containerID="820d5c275fe58fd5d41ac7bd33aeb3826c158275c1c35fec556381416263addf"
Sep 14 10:16:46.202237 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:16:46.202214    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"820d5c275fe58fd5d41ac7bd33aeb3826c158275c1c35fec556381416263addf\": container with ID starting with 820d5c275fe58fd5d41ac7bd33aeb3826c158275c1c35fec556381416263addf not found: ID does not exist" containerID="820d5c275fe58fd5d41ac7bd33aeb3826c158275c1c35fec556381416263addf"
Sep 14 10:16:46.202296 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:46.202248    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"820d5c275fe58fd5d41ac7bd33aeb3826c158275c1c35fec556381416263addf"} err="failed to get container status \"820d5c275fe58fd5d41ac7bd33aeb3826c158275c1c35fec556381416263addf\": rpc error: code = NotFound desc = could not find container \"820d5c275fe58fd5d41ac7bd33aeb3826c158275c1c35fec556381416263addf\": container with ID starting with 820d5c275fe58fd5d41ac7bd33aeb3826c158275c1c35fec556381416263addf not found: ID does not exist"
Sep 14 10:16:46.225541 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:46.225491    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b"]
Sep 14 10:16:46.228803 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:46.228769    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-78742b-5649569db6-p4k5b"]
Sep 14 10:16:46.656838 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:46.656740    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15ba66ed-f56f-456e-ac16-e55ca72a8304" path="/var/lib/kubelet/pods/15ba66ed-f56f-456e-ac16-e55ca72a8304/volumes"
Sep 14 10:16:55.981544 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:16:55.981506    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:17:45.782355 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:45.782317    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"]
Sep 14 10:17:45.782891 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:45.782634    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9" podUID="95c1914d-437d-42c0-a97c-9a9f1edd00a4" containerName="maas-api" containerID="cri-o://8ea5427116e3b15010c018c5692a548cbf1dc7fed0b64e4f0b6dc833026681e0" gracePeriod=30
Sep 14 10:17:45.844986 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:45.844956    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q"]
Sep 14 10:17:45.845195 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:45.845169    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q" podUID="7a5bb819-9a1b-48ee-a656-db4081a8fbca" containerName="payload-processing" containerID="cri-o://59449a7c4407c231eb2c56ac52b2cf4946c15e6e07c3697117e733a50291f251" gracePeriod=30
Sep 14 10:17:46.127793 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.127765    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"
Sep 14 10:17:46.150224 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.150191    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q"
Sep 14 10:17:46.236862 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.236822    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95c1914d-437d-42c0-a97c-9a9f1edd00a4-metrics-certs\") pod \"95c1914d-437d-42c0-a97c-9a9f1edd00a4\" (UID: \"95c1914d-437d-42c0-a97c-9a9f1edd00a4\") "
Sep 14 10:17:46.237049 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.236879    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a5bb819-9a1b-48ee-a656-db4081a8fbca-plugins-config-volume\") pod \"7a5bb819-9a1b-48ee-a656-db4081a8fbca\" (UID: \"7a5bb819-9a1b-48ee-a656-db4081a8fbca\") "
Sep 14 10:17:46.237049 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.236924    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7wwf\" (UniqueName: \"kubernetes.io/projected/95c1914d-437d-42c0-a97c-9a9f1edd00a4-kube-api-access-m7wwf\") pod \"95c1914d-437d-42c0-a97c-9a9f1edd00a4\" (UID: \"95c1914d-437d-42c0-a97c-9a9f1edd00a4\") "
Sep 14 10:17:46.237049 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.236961    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqjcj\" (UniqueName: \"kubernetes.io/projected/7a5bb819-9a1b-48ee-a656-db4081a8fbca-kube-api-access-wqjcj\") pod \"7a5bb819-9a1b-48ee-a656-db4081a8fbca\" (UID: \"7a5bb819-9a1b-48ee-a656-db4081a8fbca\") "
Sep 14 10:17:46.237049 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.237001    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95c1914d-437d-42c0-a97c-9a9f1edd00a4-maas-api-tls\") pod \"95c1914d-437d-42c0-a97c-9a9f1edd00a4\" (UID: \"95c1914d-437d-42c0-a97c-9a9f1edd00a4\") "
Sep 14 10:17:46.237049 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.237029    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95c1914d-437d-42c0-a97c-9a9f1edd00a4-openshift-service-ca\") pod \"95c1914d-437d-42c0-a97c-9a9f1edd00a4\" (UID: \"95c1914d-437d-42c0-a97c-9a9f1edd00a4\") "
Sep 14 10:17:46.237530 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.237493    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a5bb819-9a1b-48ee-a656-db4081a8fbca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7a5bb819-9a1b-48ee-a656-db4081a8fbca" (UID: "7a5bb819-9a1b-48ee-a656-db4081a8fbca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:17:46.237623 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.237546    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95c1914d-437d-42c0-a97c-9a9f1edd00a4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "95c1914d-437d-42c0-a97c-9a9f1edd00a4" (UID: "95c1914d-437d-42c0-a97c-9a9f1edd00a4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:17:46.239170 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.239132    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95c1914d-437d-42c0-a97c-9a9f1edd00a4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "95c1914d-437d-42c0-a97c-9a9f1edd00a4" (UID: "95c1914d-437d-42c0-a97c-9a9f1edd00a4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:17:46.239258 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.239198    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95c1914d-437d-42c0-a97c-9a9f1edd00a4-kube-api-access-m7wwf" (OuterVolumeSpecName: "kube-api-access-m7wwf") pod "95c1914d-437d-42c0-a97c-9a9f1edd00a4" (UID: "95c1914d-437d-42c0-a97c-9a9f1edd00a4"). InnerVolumeSpecName "kube-api-access-m7wwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:17:46.239258 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.239226    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a5bb819-9a1b-48ee-a656-db4081a8fbca-kube-api-access-wqjcj" (OuterVolumeSpecName: "kube-api-access-wqjcj") pod "7a5bb819-9a1b-48ee-a656-db4081a8fbca" (UID: "7a5bb819-9a1b-48ee-a656-db4081a8fbca"). InnerVolumeSpecName "kube-api-access-wqjcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:17:46.239335 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.239254    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95c1914d-437d-42c0-a97c-9a9f1edd00a4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "95c1914d-437d-42c0-a97c-9a9f1edd00a4" (UID: "95c1914d-437d-42c0-a97c-9a9f1edd00a4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:17:46.338615 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.338515    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqjcj\" (UniqueName: \"kubernetes.io/projected/7a5bb819-9a1b-48ee-a656-db4081a8fbca-kube-api-access-wqjcj\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:17:46.338615 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.338558    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95c1914d-437d-42c0-a97c-9a9f1edd00a4-maas-api-tls\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:17:46.338615 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.338569    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95c1914d-437d-42c0-a97c-9a9f1edd00a4-openshift-service-ca\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:17:46.338615 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.338578    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95c1914d-437d-42c0-a97c-9a9f1edd00a4-metrics-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:17:46.338615 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.338587    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a5bb819-9a1b-48ee-a656-db4081a8fbca-plugins-config-volume\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:17:46.338615 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.338594    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7wwf\" (UniqueName: \"kubernetes.io/projected/95c1914d-437d-42c0-a97c-9a9f1edd00a4-kube-api-access-m7wwf\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:17:46.507089 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.507054    2581 generic.go:356] "Generic (PLEG): container finished" podID="7a5bb819-9a1b-48ee-a656-db4081a8fbca" containerID="59449a7c4407c231eb2c56ac52b2cf4946c15e6e07c3697117e733a50291f251" exitCode=0
Sep 14 10:17:46.507291 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.507101    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q"
Sep 14 10:17:46.507291 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.507142    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q" event={"ID":"7a5bb819-9a1b-48ee-a656-db4081a8fbca","Type":"ContainerDied","Data":"59449a7c4407c231eb2c56ac52b2cf4946c15e6e07c3697117e733a50291f251"}
Sep 14 10:17:46.507291 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.507198    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q" event={"ID":"7a5bb819-9a1b-48ee-a656-db4081a8fbca","Type":"ContainerDied","Data":"e065b101946c7093fe4761438e03e299d430390f8624a2df6e200007b117d3ce"}
Sep 14 10:17:46.507291 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.507225    2581 scope.go:117] "RemoveContainer" containerID="59449a7c4407c231eb2c56ac52b2cf4946c15e6e07c3697117e733a50291f251"
Sep 14 10:17:46.508758 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.508735    2581 generic.go:356] "Generic (PLEG): container finished" podID="95c1914d-437d-42c0-a97c-9a9f1edd00a4" containerID="8ea5427116e3b15010c018c5692a548cbf1dc7fed0b64e4f0b6dc833026681e0" exitCode=0
Sep 14 10:17:46.508885 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.508765    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9" event={"ID":"95c1914d-437d-42c0-a97c-9a9f1edd00a4","Type":"ContainerDied","Data":"8ea5427116e3b15010c018c5692a548cbf1dc7fed0b64e4f0b6dc833026681e0"}
Sep 14 10:17:46.508885 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.508790    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"
Sep 14 10:17:46.508885 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.508818    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9" event={"ID":"95c1914d-437d-42c0-a97c-9a9f1edd00a4","Type":"ContainerDied","Data":"5d9e11aaa851280170d7fc78e21822f9c413179664aa94029fcbb4f3adda0b7a"}
Sep 14 10:17:46.517983 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.517965    2581 scope.go:117] "RemoveContainer" containerID="59449a7c4407c231eb2c56ac52b2cf4946c15e6e07c3697117e733a50291f251"
Sep 14 10:17:46.518294 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:17:46.518264    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59449a7c4407c231eb2c56ac52b2cf4946c15e6e07c3697117e733a50291f251\": container with ID starting with 59449a7c4407c231eb2c56ac52b2cf4946c15e6e07c3697117e733a50291f251 not found: ID does not exist" containerID="59449a7c4407c231eb2c56ac52b2cf4946c15e6e07c3697117e733a50291f251"
Sep 14 10:17:46.518397 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.518305    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59449a7c4407c231eb2c56ac52b2cf4946c15e6e07c3697117e733a50291f251"} err="failed to get container status \"59449a7c4407c231eb2c56ac52b2cf4946c15e6e07c3697117e733a50291f251\": rpc error: code = NotFound desc = could not find container \"59449a7c4407c231eb2c56ac52b2cf4946c15e6e07c3697117e733a50291f251\": container with ID starting with 59449a7c4407c231eb2c56ac52b2cf4946c15e6e07c3697117e733a50291f251 not found: ID does not exist"
Sep 14 10:17:46.518397 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.518333    2581 scope.go:117] "RemoveContainer" containerID="8ea5427116e3b15010c018c5692a548cbf1dc7fed0b64e4f0b6dc833026681e0"
Sep 14 10:17:46.526496 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.526473    2581 scope.go:117] "RemoveContainer" containerID="8ea5427116e3b15010c018c5692a548cbf1dc7fed0b64e4f0b6dc833026681e0"
Sep 14 10:17:46.526773 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:17:46.526752    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ea5427116e3b15010c018c5692a548cbf1dc7fed0b64e4f0b6dc833026681e0\": container with ID starting with 8ea5427116e3b15010c018c5692a548cbf1dc7fed0b64e4f0b6dc833026681e0 not found: ID does not exist" containerID="8ea5427116e3b15010c018c5692a548cbf1dc7fed0b64e4f0b6dc833026681e0"
Sep 14 10:17:46.526836 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.526780    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ea5427116e3b15010c018c5692a548cbf1dc7fed0b64e4f0b6dc833026681e0"} err="failed to get container status \"8ea5427116e3b15010c018c5692a548cbf1dc7fed0b64e4f0b6dc833026681e0\": rpc error: code = NotFound desc = could not find container \"8ea5427116e3b15010c018c5692a548cbf1dc7fed0b64e4f0b6dc833026681e0\": container with ID starting with 8ea5427116e3b15010c018c5692a548cbf1dc7fed0b64e4f0b6dc833026681e0 not found: ID does not exist"
Sep 14 10:17:46.531091 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.531068    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q"]
Sep 14 10:17:46.535420 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.535397    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-2c2a39-c974b7655-qdj7q"]
Sep 14 10:17:46.547458 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.547430    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"]
Sep 14 10:17:46.549466 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.549445    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-2c2a39-8ff794968-kz9v9"]
Sep 14 10:17:46.655637 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.655557    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a5bb819-9a1b-48ee-a656-db4081a8fbca" path="/var/lib/kubelet/pods/7a5bb819-9a1b-48ee-a656-db4081a8fbca/volumes"
Sep 14 10:17:46.655986 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:46.655973    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95c1914d-437d-42c0-a97c-9a9f1edd00a4" path="/var/lib/kubelet/pods/95c1914d-437d-42c0-a97c-9a9f1edd00a4/volumes"
Sep 14 10:17:49.077522 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:17:49.077487    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:18:06.690653 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:06.690619    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:18:21.668152 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:21.668111    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"]
Sep 14 10:18:21.668686 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:21.668357    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn" podUID="dc826e01-970f-4831-8c6b-6639e8efbbd2" containerName="maas-api" containerID="cri-o://e129de0528cf68715a452c1d5db4d0660600b1ea54b1419967001a1fc43f8d40" gracePeriod=30
Sep 14 10:18:21.731051 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:21.731012    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh"]
Sep 14 10:18:21.731347 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:21.731292    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh" podUID="f4209d28-2feb-467b-9da1-562968ed2f62" containerName="payload-pre-processing" containerID="cri-o://1d5aca113f352b0e353183586458655e6990f89de739b96573924e246212a614" gracePeriod=30
Sep 14 10:18:22.037665 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.037635    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"
Sep 14 10:18:22.052403 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.052374    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh"
Sep 14 10:18:22.188969 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.188850    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht6zm\" (UniqueName: \"kubernetes.io/projected/dc826e01-970f-4831-8c6b-6639e8efbbd2-kube-api-access-ht6zm\") pod \"dc826e01-970f-4831-8c6b-6639e8efbbd2\" (UID: \"dc826e01-970f-4831-8c6b-6639e8efbbd2\") "
Sep 14 10:18:22.188969 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.188929    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvg7s\" (UniqueName: \"kubernetes.io/projected/f4209d28-2feb-467b-9da1-562968ed2f62-kube-api-access-jvg7s\") pod \"f4209d28-2feb-467b-9da1-562968ed2f62\" (UID: \"f4209d28-2feb-467b-9da1-562968ed2f62\") "
Sep 14 10:18:22.188969 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.188980    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4209d28-2feb-467b-9da1-562968ed2f62-plugins-config-volume\") pod \"f4209d28-2feb-467b-9da1-562968ed2f62\" (UID: \"f4209d28-2feb-467b-9da1-562968ed2f62\") "
Sep 14 10:18:22.189259 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.189038    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc826e01-970f-4831-8c6b-6639e8efbbd2-maas-api-tls\") pod \"dc826e01-970f-4831-8c6b-6639e8efbbd2\" (UID: \"dc826e01-970f-4831-8c6b-6639e8efbbd2\") "
Sep 14 10:18:22.189259 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.189060    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc826e01-970f-4831-8c6b-6639e8efbbd2-openshift-service-ca\") pod \"dc826e01-970f-4831-8c6b-6639e8efbbd2\" (UID: \"dc826e01-970f-4831-8c6b-6639e8efbbd2\") "
Sep 14 10:18:22.189259 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.189115    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc826e01-970f-4831-8c6b-6639e8efbbd2-metrics-certs\") pod \"dc826e01-970f-4831-8c6b-6639e8efbbd2\" (UID: \"dc826e01-970f-4831-8c6b-6639e8efbbd2\") "
Sep 14 10:18:22.189579 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.189450    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4209d28-2feb-467b-9da1-562968ed2f62-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f4209d28-2feb-467b-9da1-562968ed2f62" (UID: "f4209d28-2feb-467b-9da1-562968ed2f62"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:18:22.189771 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.189741    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc826e01-970f-4831-8c6b-6639e8efbbd2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dc826e01-970f-4831-8c6b-6639e8efbbd2" (UID: "dc826e01-970f-4831-8c6b-6639e8efbbd2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:18:22.191254 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.191219    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc826e01-970f-4831-8c6b-6639e8efbbd2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dc826e01-970f-4831-8c6b-6639e8efbbd2" (UID: "dc826e01-970f-4831-8c6b-6639e8efbbd2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:18:22.191254 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.191235    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc826e01-970f-4831-8c6b-6639e8efbbd2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "dc826e01-970f-4831-8c6b-6639e8efbbd2" (UID: "dc826e01-970f-4831-8c6b-6639e8efbbd2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:18:22.191584 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.191559    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4209d28-2feb-467b-9da1-562968ed2f62-kube-api-access-jvg7s" (OuterVolumeSpecName: "kube-api-access-jvg7s") pod "f4209d28-2feb-467b-9da1-562968ed2f62" (UID: "f4209d28-2feb-467b-9da1-562968ed2f62"). InnerVolumeSpecName "kube-api-access-jvg7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:18:22.191621 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.191594    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc826e01-970f-4831-8c6b-6639e8efbbd2-kube-api-access-ht6zm" (OuterVolumeSpecName: "kube-api-access-ht6zm") pod "dc826e01-970f-4831-8c6b-6639e8efbbd2" (UID: "dc826e01-970f-4831-8c6b-6639e8efbbd2"). InnerVolumeSpecName "kube-api-access-ht6zm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:18:22.290931 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.290885    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4209d28-2feb-467b-9da1-562968ed2f62-plugins-config-volume\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:18:22.290931 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.290921    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc826e01-970f-4831-8c6b-6639e8efbbd2-maas-api-tls\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:18:22.290931 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.290932    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc826e01-970f-4831-8c6b-6639e8efbbd2-openshift-service-ca\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:18:22.290931 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.290940    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc826e01-970f-4831-8c6b-6639e8efbbd2-metrics-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:18:22.291213 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.290949    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht6zm\" (UniqueName: \"kubernetes.io/projected/dc826e01-970f-4831-8c6b-6639e8efbbd2-kube-api-access-ht6zm\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:18:22.291213 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.290957    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvg7s\" (UniqueName: \"kubernetes.io/projected/f4209d28-2feb-467b-9da1-562968ed2f62-kube-api-access-jvg7s\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:18:22.696029 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.695996    2581 generic.go:356] "Generic (PLEG): container finished" podID="dc826e01-970f-4831-8c6b-6639e8efbbd2" containerID="e129de0528cf68715a452c1d5db4d0660600b1ea54b1419967001a1fc43f8d40" exitCode=0
Sep 14 10:18:22.696495 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.696062    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"
Sep 14 10:18:22.696495 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.696085    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn" event={"ID":"dc826e01-970f-4831-8c6b-6639e8efbbd2","Type":"ContainerDied","Data":"e129de0528cf68715a452c1d5db4d0660600b1ea54b1419967001a1fc43f8d40"}
Sep 14 10:18:22.696495 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.696164    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn" event={"ID":"dc826e01-970f-4831-8c6b-6639e8efbbd2","Type":"ContainerDied","Data":"e9a48289c886a1609d1758fd1e9f0ec1c437e1c90a5718e2e04e92f76bd4eba2"}
Sep 14 10:18:22.696495 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.696199    2581 scope.go:117] "RemoveContainer" containerID="e129de0528cf68715a452c1d5db4d0660600b1ea54b1419967001a1fc43f8d40"
Sep 14 10:18:22.697935 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.697658    2581 generic.go:356] "Generic (PLEG): container finished" podID="f4209d28-2feb-467b-9da1-562968ed2f62" containerID="1d5aca113f352b0e353183586458655e6990f89de739b96573924e246212a614" exitCode=0
Sep 14 10:18:22.697935 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.697691    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh"
Sep 14 10:18:22.697935 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.697751    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh" event={"ID":"f4209d28-2feb-467b-9da1-562968ed2f62","Type":"ContainerDied","Data":"1d5aca113f352b0e353183586458655e6990f89de739b96573924e246212a614"}
Sep 14 10:18:22.697935 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.697798    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh" event={"ID":"f4209d28-2feb-467b-9da1-562968ed2f62","Type":"ContainerDied","Data":"a2dc18b3e835354fd2df2c741c32987f732d833c8b39af8ba6d3ebc5585001fc"}
Sep 14 10:18:22.705496 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.705477    2581 scope.go:117] "RemoveContainer" containerID="e129de0528cf68715a452c1d5db4d0660600b1ea54b1419967001a1fc43f8d40"
Sep 14 10:18:22.705816 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:18:22.705796    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e129de0528cf68715a452c1d5db4d0660600b1ea54b1419967001a1fc43f8d40\": container with ID starting with e129de0528cf68715a452c1d5db4d0660600b1ea54b1419967001a1fc43f8d40 not found: ID does not exist" containerID="e129de0528cf68715a452c1d5db4d0660600b1ea54b1419967001a1fc43f8d40"
Sep 14 10:18:22.705908 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.705828    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e129de0528cf68715a452c1d5db4d0660600b1ea54b1419967001a1fc43f8d40"} err="failed to get container status \"e129de0528cf68715a452c1d5db4d0660600b1ea54b1419967001a1fc43f8d40\": rpc error: code = NotFound desc = could not find container \"e129de0528cf68715a452c1d5db4d0660600b1ea54b1419967001a1fc43f8d40\": container with ID starting with e129de0528cf68715a452c1d5db4d0660600b1ea54b1419967001a1fc43f8d40 not found: ID does not exist"
Sep 14 10:18:22.705908 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.705855    2581 scope.go:117] "RemoveContainer" containerID="1d5aca113f352b0e353183586458655e6990f89de739b96573924e246212a614"
Sep 14 10:18:22.713820 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.713796    2581 scope.go:117] "RemoveContainer" containerID="1d5aca113f352b0e353183586458655e6990f89de739b96573924e246212a614"
Sep 14 10:18:22.714224 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:18:22.714200    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d5aca113f352b0e353183586458655e6990f89de739b96573924e246212a614\": container with ID starting with 1d5aca113f352b0e353183586458655e6990f89de739b96573924e246212a614 not found: ID does not exist" containerID="1d5aca113f352b0e353183586458655e6990f89de739b96573924e246212a614"
Sep 14 10:18:22.714310 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.714250    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d5aca113f352b0e353183586458655e6990f89de739b96573924e246212a614"} err="failed to get container status \"1d5aca113f352b0e353183586458655e6990f89de739b96573924e246212a614\": rpc error: code = NotFound desc = could not find container \"1d5aca113f352b0e353183586458655e6990f89de739b96573924e246212a614\": container with ID starting with 1d5aca113f352b0e353183586458655e6990f89de739b96573924e246212a614 not found: ID does not exist"
Sep 14 10:18:22.716431 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.716409    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"]
Sep 14 10:18:22.720506 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.720483    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-f4d054-776699b744-95bjn"]
Sep 14 10:18:22.733703 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.733674    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh"]
Sep 14 10:18:22.742559 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:22.742533    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4d054-745995774b-6cmxh"]
Sep 14 10:18:24.575670 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:24.575627    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:18:24.657334 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:24.657301    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc826e01-970f-4831-8c6b-6639e8efbbd2" path="/var/lib/kubelet/pods/dc826e01-970f-4831-8c6b-6639e8efbbd2/volumes"
Sep 14 10:18:24.657697 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:24.657682    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4209d28-2feb-467b-9da1-562968ed2f62" path="/var/lib/kubelet/pods/f4209d28-2feb-467b-9da1-562968ed2f62/volumes"
Sep 14 10:18:31.315635 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:31.315594    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6dfbdc546b-tzlgv"]
Sep 14 10:18:31.316074 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:31.315896    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6dfbdc546b-tzlgv" podUID="7479590e-8806-4577-bf15-cfdc5cafd92a" containerName="manager" containerID="cri-o://ce2f827450b8931f72b1b5fa66c18a95b8d421b5d88bb1dd7023a0431ce83b50" gracePeriod=30
Sep 14 10:18:31.568919 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:31.568840    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dfbdc546b-tzlgv"
Sep 14 10:18:31.571862 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:31.571838    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfj6q\" (UniqueName: \"kubernetes.io/projected/7479590e-8806-4577-bf15-cfdc5cafd92a-kube-api-access-bfj6q\") pod \"7479590e-8806-4577-bf15-cfdc5cafd92a\" (UID: \"7479590e-8806-4577-bf15-cfdc5cafd92a\") "
Sep 14 10:18:31.571927 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:31.571895    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7479590e-8806-4577-bf15-cfdc5cafd92a-webhook-cert\") pod \"7479590e-8806-4577-bf15-cfdc5cafd92a\" (UID: \"7479590e-8806-4577-bf15-cfdc5cafd92a\") "
Sep 14 10:18:31.571965 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:31.571940    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7479590e-8806-4577-bf15-cfdc5cafd92a-metrics-certs\") pod \"7479590e-8806-4577-bf15-cfdc5cafd92a\" (UID: \"7479590e-8806-4577-bf15-cfdc5cafd92a\") "
Sep 14 10:18:31.574199 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:31.574164    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7479590e-8806-4577-bf15-cfdc5cafd92a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7479590e-8806-4577-bf15-cfdc5cafd92a" (UID: "7479590e-8806-4577-bf15-cfdc5cafd92a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:18:31.574199 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:31.574170    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7479590e-8806-4577-bf15-cfdc5cafd92a-kube-api-access-bfj6q" (OuterVolumeSpecName: "kube-api-access-bfj6q") pod "7479590e-8806-4577-bf15-cfdc5cafd92a" (UID: "7479590e-8806-4577-bf15-cfdc5cafd92a"). InnerVolumeSpecName "kube-api-access-bfj6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:18:31.574349 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:31.574253    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7479590e-8806-4577-bf15-cfdc5cafd92a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7479590e-8806-4577-bf15-cfdc5cafd92a" (UID: "7479590e-8806-4577-bf15-cfdc5cafd92a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:18:31.673012 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:31.672973    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7479590e-8806-4577-bf15-cfdc5cafd92a-webhook-cert\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:18:31.673012 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:31.673005    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7479590e-8806-4577-bf15-cfdc5cafd92a-metrics-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:18:31.673012 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:31.673014    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfj6q\" (UniqueName: \"kubernetes.io/projected/7479590e-8806-4577-bf15-cfdc5cafd92a-kube-api-access-bfj6q\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:18:31.746281 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:31.746243    2581 generic.go:356] "Generic (PLEG): container finished" podID="7479590e-8806-4577-bf15-cfdc5cafd92a" containerID="ce2f827450b8931f72b1b5fa66c18a95b8d421b5d88bb1dd7023a0431ce83b50" exitCode=0
Sep 14 10:18:31.746429 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:31.746290    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dfbdc546b-tzlgv"
Sep 14 10:18:31.746429 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:31.746332    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dfbdc546b-tzlgv" event={"ID":"7479590e-8806-4577-bf15-cfdc5cafd92a","Type":"ContainerDied","Data":"ce2f827450b8931f72b1b5fa66c18a95b8d421b5d88bb1dd7023a0431ce83b50"}
Sep 14 10:18:31.746429 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:31.746385    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dfbdc546b-tzlgv" event={"ID":"7479590e-8806-4577-bf15-cfdc5cafd92a","Type":"ContainerDied","Data":"17b740157818540265daf713b36eeb91c00676ba36aa09aaeb553f51ec186238"}
Sep 14 10:18:31.746429 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:31.746410    2581 scope.go:117] "RemoveContainer" containerID="ce2f827450b8931f72b1b5fa66c18a95b8d421b5d88bb1dd7023a0431ce83b50"
Sep 14 10:18:31.756166 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:31.756147    2581 scope.go:117] "RemoveContainer" containerID="ce2f827450b8931f72b1b5fa66c18a95b8d421b5d88bb1dd7023a0431ce83b50"
Sep 14 10:18:31.756502 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:18:31.756479    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce2f827450b8931f72b1b5fa66c18a95b8d421b5d88bb1dd7023a0431ce83b50\": container with ID starting with ce2f827450b8931f72b1b5fa66c18a95b8d421b5d88bb1dd7023a0431ce83b50 not found: ID does not exist" containerID="ce2f827450b8931f72b1b5fa66c18a95b8d421b5d88bb1dd7023a0431ce83b50"
Sep 14 10:18:31.756551 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:31.756510    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce2f827450b8931f72b1b5fa66c18a95b8d421b5d88bb1dd7023a0431ce83b50"} err="failed to get container status \"ce2f827450b8931f72b1b5fa66c18a95b8d421b5d88bb1dd7023a0431ce83b50\": rpc error: code = NotFound desc = could not find container \"ce2f827450b8931f72b1b5fa66c18a95b8d421b5d88bb1dd7023a0431ce83b50\": container with ID starting with ce2f827450b8931f72b1b5fa66c18a95b8d421b5d88bb1dd7023a0431ce83b50 not found: ID does not exist"
Sep 14 10:18:31.768105 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:31.768074    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6dfbdc546b-tzlgv"]
Sep 14 10:18:31.770436 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:31.770410    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6dfbdc546b-tzlgv"]
Sep 14 10:18:32.656212 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:32.656176    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7479590e-8806-4577-bf15-cfdc5cafd92a" path="/var/lib/kubelet/pods/7479590e-8806-4577-bf15-cfdc5cafd92a/volumes"
Sep 14 10:18:33.386654 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:18:33.386617    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:19:32.561547 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.561509    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6dfbdc546b-ppn2s"]
Sep 14 10:19:32.562029 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.561925    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ba66ed-f56f-456e-ac16-e55ca72a8304" containerName="payload-pre-processing"
Sep 14 10:19:32.562029 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.561939    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ba66ed-f56f-456e-ac16-e55ca72a8304" containerName="payload-pre-processing"
Sep 14 10:19:32.562029 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.561948    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95c1914d-437d-42c0-a97c-9a9f1edd00a4" containerName="maas-api"
Sep 14 10:19:32.562029 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.561953    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="95c1914d-437d-42c0-a97c-9a9f1edd00a4" containerName="maas-api"
Sep 14 10:19:32.562029 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.561962    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4209d28-2feb-467b-9da1-562968ed2f62" containerName="payload-pre-processing"
Sep 14 10:19:32.562029 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.561967    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4209d28-2feb-467b-9da1-562968ed2f62" containerName="payload-pre-processing"
Sep 14 10:19:32.562029 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.561973    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3505bad-0ef1-44e5-89d1-1366b42110ae" containerName="payload-pre-processing"
Sep 14 10:19:32.562029 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.561979    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3505bad-0ef1-44e5-89d1-1366b42110ae" containerName="payload-pre-processing"
Sep 14 10:19:32.562029 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.561987    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc826e01-970f-4831-8c6b-6639e8efbbd2" containerName="maas-api"
Sep 14 10:19:32.562029 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.561993    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc826e01-970f-4831-8c6b-6639e8efbbd2" containerName="maas-api"
Sep 14 10:19:32.562029 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.562004    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7479590e-8806-4577-bf15-cfdc5cafd92a" containerName="manager"
Sep 14 10:19:32.562029 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.562009    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7479590e-8806-4577-bf15-cfdc5cafd92a" containerName="manager"
Sep 14 10:19:32.562029 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.562017    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a5bb819-9a1b-48ee-a656-db4081a8fbca" containerName="payload-processing"
Sep 14 10:19:32.562029 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.562022    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a5bb819-9a1b-48ee-a656-db4081a8fbca" containerName="payload-processing"
Sep 14 10:19:32.562527 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.562080    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7479590e-8806-4577-bf15-cfdc5cafd92a" containerName="manager"
Sep 14 10:19:32.562527 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.562090    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a5bb819-9a1b-48ee-a656-db4081a8fbca" containerName="payload-processing"
Sep 14 10:19:32.562527 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.562096    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc826e01-970f-4831-8c6b-6639e8efbbd2" containerName="maas-api"
Sep 14 10:19:32.562527 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.562102    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4209d28-2feb-467b-9da1-562968ed2f62" containerName="payload-pre-processing"
Sep 14 10:19:32.562527 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.562108    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="15ba66ed-f56f-456e-ac16-e55ca72a8304" containerName="payload-pre-processing"
Sep 14 10:19:32.562527 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.562116    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3505bad-0ef1-44e5-89d1-1366b42110ae" containerName="payload-pre-processing"
Sep 14 10:19:32.562527 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.562123    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="95c1914d-437d-42c0-a97c-9a9f1edd00a4" containerName="maas-api"
Sep 14 10:19:32.568858 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.568832    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dfbdc546b-ppn2s"
Sep 14 10:19:32.572005 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.571982    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 14 10:19:32.573309 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.573283    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-cghpj\""
Sep 14 10:19:32.573413 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.573365    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 14 10:19:32.573494 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.573325    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 14 10:19:32.575996 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.575972    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dfbdc546b-ppn2s"]
Sep 14 10:19:32.626948 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.626908    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/38e76a90-ac52-40ae-a4e3-08b87ed49d1a-webhook-cert\") pod \"maas-controller-6dfbdc546b-ppn2s\" (UID: \"38e76a90-ac52-40ae-a4e3-08b87ed49d1a\") " pod="opendatahub/maas-controller-6dfbdc546b-ppn2s"
Sep 14 10:19:32.626948 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.626945    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e76a90-ac52-40ae-a4e3-08b87ed49d1a-metrics-certs\") pod \"maas-controller-6dfbdc546b-ppn2s\" (UID: \"38e76a90-ac52-40ae-a4e3-08b87ed49d1a\") " pod="opendatahub/maas-controller-6dfbdc546b-ppn2s"
Sep 14 10:19:32.627171 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.626968    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24tsj\" (UniqueName: \"kubernetes.io/projected/38e76a90-ac52-40ae-a4e3-08b87ed49d1a-kube-api-access-24tsj\") pod \"maas-controller-6dfbdc546b-ppn2s\" (UID: \"38e76a90-ac52-40ae-a4e3-08b87ed49d1a\") " pod="opendatahub/maas-controller-6dfbdc546b-ppn2s"
Sep 14 10:19:32.727848 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.727798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/38e76a90-ac52-40ae-a4e3-08b87ed49d1a-webhook-cert\") pod \"maas-controller-6dfbdc546b-ppn2s\" (UID: \"38e76a90-ac52-40ae-a4e3-08b87ed49d1a\") " pod="opendatahub/maas-controller-6dfbdc546b-ppn2s"
Sep 14 10:19:32.728019 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.727857    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e76a90-ac52-40ae-a4e3-08b87ed49d1a-metrics-certs\") pod \"maas-controller-6dfbdc546b-ppn2s\" (UID: \"38e76a90-ac52-40ae-a4e3-08b87ed49d1a\") " pod="opendatahub/maas-controller-6dfbdc546b-ppn2s"
Sep 14 10:19:32.728019 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.727888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24tsj\" (UniqueName: \"kubernetes.io/projected/38e76a90-ac52-40ae-a4e3-08b87ed49d1a-kube-api-access-24tsj\") pod \"maas-controller-6dfbdc546b-ppn2s\" (UID: \"38e76a90-ac52-40ae-a4e3-08b87ed49d1a\") " pod="opendatahub/maas-controller-6dfbdc546b-ppn2s"
Sep 14 10:19:32.730404 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.730367    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/38e76a90-ac52-40ae-a4e3-08b87ed49d1a-webhook-cert\") pod \"maas-controller-6dfbdc546b-ppn2s\" (UID: \"38e76a90-ac52-40ae-a4e3-08b87ed49d1a\") " pod="opendatahub/maas-controller-6dfbdc546b-ppn2s"
Sep 14 10:19:32.730534 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.730399    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e76a90-ac52-40ae-a4e3-08b87ed49d1a-metrics-certs\") pod \"maas-controller-6dfbdc546b-ppn2s\" (UID: \"38e76a90-ac52-40ae-a4e3-08b87ed49d1a\") " pod="opendatahub/maas-controller-6dfbdc546b-ppn2s"
Sep 14 10:19:32.736646 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.736618    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24tsj\" (UniqueName: \"kubernetes.io/projected/38e76a90-ac52-40ae-a4e3-08b87ed49d1a-kube-api-access-24tsj\") pod \"maas-controller-6dfbdc546b-ppn2s\" (UID: \"38e76a90-ac52-40ae-a4e3-08b87ed49d1a\") " pod="opendatahub/maas-controller-6dfbdc546b-ppn2s"
Sep 14 10:19:32.880488 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:32.880390    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dfbdc546b-ppn2s"
Sep 14 10:19:33.156722 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:33.156678    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dfbdc546b-ppn2s"]
Sep 14 10:19:33.157394 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:19:33.157366    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38e76a90_ac52_40ae_a4e3_08b87ed49d1a.slice/crio-e6827e1b9469d16f051990229ec904999195d40e689a4d2941c0d8fdabcf0719 WatchSource:0}: Error finding container e6827e1b9469d16f051990229ec904999195d40e689a4d2941c0d8fdabcf0719: Status 404 returned error can't find the container with id e6827e1b9469d16f051990229ec904999195d40e689a4d2941c0d8fdabcf0719
Sep 14 10:19:34.062685 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:34.062508    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dfbdc546b-ppn2s" event={"ID":"38e76a90-ac52-40ae-a4e3-08b87ed49d1a","Type":"ContainerStarted","Data":"c044ee7781d7ec17a8269e30f51acfbfdc245930235b47f0417c75d636070920"}
Sep 14 10:19:34.062685 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:34.062571    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dfbdc546b-ppn2s" event={"ID":"38e76a90-ac52-40ae-a4e3-08b87ed49d1a","Type":"ContainerStarted","Data":"e6827e1b9469d16f051990229ec904999195d40e689a4d2941c0d8fdabcf0719"}
Sep 14 10:19:34.062685 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:34.062601    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6dfbdc546b-ppn2s"
Sep 14 10:19:34.083449 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:34.083400    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6dfbdc546b-ppn2s" podStartSLOduration=1.467674637 podStartE2EDuration="2.083382392s" totalImagesPullingTime="615.707755ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:19:34.080678742 +0000 UTC m=+2189.938911108" watchObservedRunningTime="2026-09-14 10:19:34.083382392 +0000 UTC m=+2189.941614750"
Sep 14 10:19:45.070473 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:45.070444    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6dfbdc546b-ppn2s"
Sep 14 10:19:55.879189 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:55.879145    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:19:56.459471 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:56.459424    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6dfbdc546b-ppn2s"]
Sep 14 10:19:56.459772 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:56.459724    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6dfbdc546b-ppn2s" podUID="38e76a90-ac52-40ae-a4e3-08b87ed49d1a" containerName="manager" containerID="cri-o://c044ee7781d7ec17a8269e30f51acfbfdc245930235b47f0417c75d636070920" gracePeriod=30
Sep 14 10:19:56.716100 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:56.716032    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dfbdc546b-ppn2s"
Sep 14 10:19:56.860608 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:56.860571    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24tsj\" (UniqueName: \"kubernetes.io/projected/38e76a90-ac52-40ae-a4e3-08b87ed49d1a-kube-api-access-24tsj\") pod \"38e76a90-ac52-40ae-a4e3-08b87ed49d1a\" (UID: \"38e76a90-ac52-40ae-a4e3-08b87ed49d1a\") "
Sep 14 10:19:56.860816 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:56.860629    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e76a90-ac52-40ae-a4e3-08b87ed49d1a-metrics-certs\") pod \"38e76a90-ac52-40ae-a4e3-08b87ed49d1a\" (UID: \"38e76a90-ac52-40ae-a4e3-08b87ed49d1a\") "
Sep 14 10:19:56.860816 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:56.860693    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/38e76a90-ac52-40ae-a4e3-08b87ed49d1a-webhook-cert\") pod \"38e76a90-ac52-40ae-a4e3-08b87ed49d1a\" (UID: \"38e76a90-ac52-40ae-a4e3-08b87ed49d1a\") "
Sep 14 10:19:56.862918 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:56.862884    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38e76a90-ac52-40ae-a4e3-08b87ed49d1a-kube-api-access-24tsj" (OuterVolumeSpecName: "kube-api-access-24tsj") pod "38e76a90-ac52-40ae-a4e3-08b87ed49d1a" (UID: "38e76a90-ac52-40ae-a4e3-08b87ed49d1a"). InnerVolumeSpecName "kube-api-access-24tsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:19:56.863049 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:56.862979    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38e76a90-ac52-40ae-a4e3-08b87ed49d1a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "38e76a90-ac52-40ae-a4e3-08b87ed49d1a" (UID: "38e76a90-ac52-40ae-a4e3-08b87ed49d1a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:19:56.863269 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:56.863251    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38e76a90-ac52-40ae-a4e3-08b87ed49d1a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "38e76a90-ac52-40ae-a4e3-08b87ed49d1a" (UID: "38e76a90-ac52-40ae-a4e3-08b87ed49d1a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:19:56.961810 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:56.961778    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24tsj\" (UniqueName: \"kubernetes.io/projected/38e76a90-ac52-40ae-a4e3-08b87ed49d1a-kube-api-access-24tsj\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:19:56.961810 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:56.961806    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/38e76a90-ac52-40ae-a4e3-08b87ed49d1a-metrics-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:19:56.961810 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:56.961815    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/38e76a90-ac52-40ae-a4e3-08b87ed49d1a-webhook-cert\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:19:57.182841 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:57.182801    2581 generic.go:356] "Generic (PLEG): container finished" podID="38e76a90-ac52-40ae-a4e3-08b87ed49d1a" containerID="c044ee7781d7ec17a8269e30f51acfbfdc245930235b47f0417c75d636070920" exitCode=0
Sep 14 10:19:57.182987 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:57.182850    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dfbdc546b-ppn2s"
Sep 14 10:19:57.182987 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:57.182889    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dfbdc546b-ppn2s" event={"ID":"38e76a90-ac52-40ae-a4e3-08b87ed49d1a","Type":"ContainerDied","Data":"c044ee7781d7ec17a8269e30f51acfbfdc245930235b47f0417c75d636070920"}
Sep 14 10:19:57.182987 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:57.182945    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dfbdc546b-ppn2s" event={"ID":"38e76a90-ac52-40ae-a4e3-08b87ed49d1a","Type":"ContainerDied","Data":"e6827e1b9469d16f051990229ec904999195d40e689a4d2941c0d8fdabcf0719"}
Sep 14 10:19:57.182987 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:57.182970    2581 scope.go:117] "RemoveContainer" containerID="c044ee7781d7ec17a8269e30f51acfbfdc245930235b47f0417c75d636070920"
Sep 14 10:19:57.195268 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:57.195246    2581 scope.go:117] "RemoveContainer" containerID="c044ee7781d7ec17a8269e30f51acfbfdc245930235b47f0417c75d636070920"
Sep 14 10:19:57.195570 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:19:57.195548    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c044ee7781d7ec17a8269e30f51acfbfdc245930235b47f0417c75d636070920\": container with ID starting with c044ee7781d7ec17a8269e30f51acfbfdc245930235b47f0417c75d636070920 not found: ID does not exist" containerID="c044ee7781d7ec17a8269e30f51acfbfdc245930235b47f0417c75d636070920"
Sep 14 10:19:57.195649 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:57.195580    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c044ee7781d7ec17a8269e30f51acfbfdc245930235b47f0417c75d636070920"} err="failed to get container status \"c044ee7781d7ec17a8269e30f51acfbfdc245930235b47f0417c75d636070920\": rpc error: code = NotFound desc = could not find container \"c044ee7781d7ec17a8269e30f51acfbfdc245930235b47f0417c75d636070920\": container with ID starting with c044ee7781d7ec17a8269e30f51acfbfdc245930235b47f0417c75d636070920 not found: ID does not exist"
Sep 14 10:19:57.205445 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:57.205422    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6dfbdc546b-ppn2s"]
Sep 14 10:19:57.210955 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:57.210932    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6dfbdc546b-ppn2s"]
Sep 14 10:19:57.960409 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:57.960372    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6dfbdc546b-cq6f6"]
Sep 14 10:19:57.961007 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:57.960987    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38e76a90-ac52-40ae-a4e3-08b87ed49d1a" containerName="manager"
Sep 14 10:19:57.961069 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:57.961012    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="38e76a90-ac52-40ae-a4e3-08b87ed49d1a" containerName="manager"
Sep 14 10:19:57.961106 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:57.961095    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="38e76a90-ac52-40ae-a4e3-08b87ed49d1a" containerName="manager"
Sep 14 10:19:57.965451 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:57.965426    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dfbdc546b-cq6f6"
Sep 14 10:19:57.969530 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:57.969507    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-cghpj\""
Sep 14 10:19:57.969647 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:57.969569    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 14 10:19:57.969748 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:57.969686    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 14 10:19:57.969901 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:57.969877    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 14 10:19:57.972741 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:57.972698    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dfbdc546b-cq6f6"]
Sep 14 10:19:58.070614 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:58.070573    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d60fa7-4ce2-4ea9-95b3-9995d5743658-metrics-certs\") pod \"maas-controller-6dfbdc546b-cq6f6\" (UID: \"e3d60fa7-4ce2-4ea9-95b3-9995d5743658\") " pod="opendatahub/maas-controller-6dfbdc546b-cq6f6"
Sep 14 10:19:58.070790 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:58.070626    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbm6x\" (UniqueName: \"kubernetes.io/projected/e3d60fa7-4ce2-4ea9-95b3-9995d5743658-kube-api-access-kbm6x\") pod \"maas-controller-6dfbdc546b-cq6f6\" (UID: \"e3d60fa7-4ce2-4ea9-95b3-9995d5743658\") " pod="opendatahub/maas-controller-6dfbdc546b-cq6f6"
Sep 14 10:19:58.070790 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:58.070738    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3d60fa7-4ce2-4ea9-95b3-9995d5743658-webhook-cert\") pod \"maas-controller-6dfbdc546b-cq6f6\" (UID: \"e3d60fa7-4ce2-4ea9-95b3-9995d5743658\") " pod="opendatahub/maas-controller-6dfbdc546b-cq6f6"
Sep 14 10:19:58.172217 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:58.172178    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d60fa7-4ce2-4ea9-95b3-9995d5743658-metrics-certs\") pod \"maas-controller-6dfbdc546b-cq6f6\" (UID: \"e3d60fa7-4ce2-4ea9-95b3-9995d5743658\") " pod="opendatahub/maas-controller-6dfbdc546b-cq6f6"
Sep 14 10:19:58.172390 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:58.172226    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbm6x\" (UniqueName: \"kubernetes.io/projected/e3d60fa7-4ce2-4ea9-95b3-9995d5743658-kube-api-access-kbm6x\") pod \"maas-controller-6dfbdc546b-cq6f6\" (UID: \"e3d60fa7-4ce2-4ea9-95b3-9995d5743658\") " pod="opendatahub/maas-controller-6dfbdc546b-cq6f6"
Sep 14 10:19:58.172390 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:58.172270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3d60fa7-4ce2-4ea9-95b3-9995d5743658-webhook-cert\") pod \"maas-controller-6dfbdc546b-cq6f6\" (UID: \"e3d60fa7-4ce2-4ea9-95b3-9995d5743658\") " pod="opendatahub/maas-controller-6dfbdc546b-cq6f6"
Sep 14 10:19:58.174784 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:58.174756    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3d60fa7-4ce2-4ea9-95b3-9995d5743658-metrics-certs\") pod \"maas-controller-6dfbdc546b-cq6f6\" (UID: \"e3d60fa7-4ce2-4ea9-95b3-9995d5743658\") " pod="opendatahub/maas-controller-6dfbdc546b-cq6f6"
Sep 14 10:19:58.174896 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:58.174883    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3d60fa7-4ce2-4ea9-95b3-9995d5743658-webhook-cert\") pod \"maas-controller-6dfbdc546b-cq6f6\" (UID: \"e3d60fa7-4ce2-4ea9-95b3-9995d5743658\") " pod="opendatahub/maas-controller-6dfbdc546b-cq6f6"
Sep 14 10:19:58.180778 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:58.180746    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbm6x\" (UniqueName: \"kubernetes.io/projected/e3d60fa7-4ce2-4ea9-95b3-9995d5743658-kube-api-access-kbm6x\") pod \"maas-controller-6dfbdc546b-cq6f6\" (UID: \"e3d60fa7-4ce2-4ea9-95b3-9995d5743658\") " pod="opendatahub/maas-controller-6dfbdc546b-cq6f6"
Sep 14 10:19:58.277490 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:58.277401    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dfbdc546b-cq6f6"
Sep 14 10:19:58.552728 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:58.552685    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dfbdc546b-cq6f6"]
Sep 14 10:19:58.554998 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:19:58.554965    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3d60fa7_4ce2_4ea9_95b3_9995d5743658.slice/crio-788393c6ec12f0822ecda75932b8310d669564490bf42d4dcf8edfa729b86fb5 WatchSource:0}: Error finding container 788393c6ec12f0822ecda75932b8310d669564490bf42d4dcf8edfa729b86fb5: Status 404 returned error can't find the container with id 788393c6ec12f0822ecda75932b8310d669564490bf42d4dcf8edfa729b86fb5
Sep 14 10:19:58.556528 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:58.556504    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 14 10:19:58.655860 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:58.655821    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38e76a90-ac52-40ae-a4e3-08b87ed49d1a" path="/var/lib/kubelet/pods/38e76a90-ac52-40ae-a4e3-08b87ed49d1a/volumes"
Sep 14 10:19:59.196007 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:59.195971    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dfbdc546b-cq6f6" event={"ID":"e3d60fa7-4ce2-4ea9-95b3-9995d5743658","Type":"ContainerStarted","Data":"8dacf1aea68af0c2d41512ee47c8ed6694932e8c3dac7ad1b81173a131744bd3"}
Sep 14 10:19:59.196434 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:59.196036    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dfbdc546b-cq6f6" event={"ID":"e3d60fa7-4ce2-4ea9-95b3-9995d5743658","Type":"ContainerStarted","Data":"788393c6ec12f0822ecda75932b8310d669564490bf42d4dcf8edfa729b86fb5"}
Sep 14 10:19:59.196434 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:59.196128    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6dfbdc546b-cq6f6"
Sep 14 10:19:59.215012 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:19:59.214961    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6dfbdc546b-cq6f6" podStartSLOduration=1.885934636 podStartE2EDuration="2.214942626s" totalImagesPullingTime="329.00799ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:19:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:19:59.21381201 +0000 UTC m=+2215.072044366" watchObservedRunningTime="2026-09-14 10:19:59.214942626 +0000 UTC m=+2215.073174981"
Sep 14 10:20:10.203228 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:20:10.203191    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6dfbdc546b-cq6f6"
Sep 14 10:20:23.973606 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:20:23.973561    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:20:31.776064 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:20:31.775959    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:20:40.394418 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:20:40.394381    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:20:57.978700 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:20:57.978659    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:21:04.378462 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:21:04.378423    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:22:33.080280 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:22:33.080244    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:22:39.674078 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:22:39.674036    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:22:46.581752 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:22:46.581689    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:23:07.824407 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:07.824370    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:23:29.371077 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:29.370999    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:23:37.992237 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:37.992199    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:23:47.486479 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:47.486435    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:23:55.074906 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:55.074871    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:23:55.426184 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:55.426103    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf"]
Sep 14 10:23:55.433030 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:55.432992    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf"
Sep 14 10:23:55.445188 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:55.445159    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf"]
Sep 14 10:23:55.501118 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:55.501083    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cd63fb5-8403-4717-8ffb-fa10ef72e4af-openshift-service-ca\") pod \"maas-api-88c4c66b5-zxfjf\" (UID: \"1cd63fb5-8403-4717-8ffb-fa10ef72e4af\") " pod="odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf"
Sep 14 10:23:55.501118 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:55.501117    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgqsk\" (UniqueName: \"kubernetes.io/projected/1cd63fb5-8403-4717-8ffb-fa10ef72e4af-kube-api-access-kgqsk\") pod \"maas-api-88c4c66b5-zxfjf\" (UID: \"1cd63fb5-8403-4717-8ffb-fa10ef72e4af\") " pod="odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf"
Sep 14 10:23:55.501318 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:55.501211    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1cd63fb5-8403-4717-8ffb-fa10ef72e4af-maas-api-tls\") pod \"maas-api-88c4c66b5-zxfjf\" (UID: \"1cd63fb5-8403-4717-8ffb-fa10ef72e4af\") " pod="odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf"
Sep 14 10:23:55.501318 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:55.501255    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1cd63fb5-8403-4717-8ffb-fa10ef72e4af-metrics-certs\") pod \"maas-api-88c4c66b5-zxfjf\" (UID: \"1cd63fb5-8403-4717-8ffb-fa10ef72e4af\") " pod="odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf"
Sep 14 10:23:55.602161 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:55.602111    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1cd63fb5-8403-4717-8ffb-fa10ef72e4af-maas-api-tls\") pod \"maas-api-88c4c66b5-zxfjf\" (UID: \"1cd63fb5-8403-4717-8ffb-fa10ef72e4af\") " pod="odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf"
Sep 14 10:23:55.602311 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:55.602205    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1cd63fb5-8403-4717-8ffb-fa10ef72e4af-metrics-certs\") pod \"maas-api-88c4c66b5-zxfjf\" (UID: \"1cd63fb5-8403-4717-8ffb-fa10ef72e4af\") " pod="odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf"
Sep 14 10:23:55.602396 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:55.602372    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cd63fb5-8403-4717-8ffb-fa10ef72e4af-openshift-service-ca\") pod \"maas-api-88c4c66b5-zxfjf\" (UID: \"1cd63fb5-8403-4717-8ffb-fa10ef72e4af\") " pod="odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf"
Sep 14 10:23:55.602437 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:55.602418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgqsk\" (UniqueName: \"kubernetes.io/projected/1cd63fb5-8403-4717-8ffb-fa10ef72e4af-kube-api-access-kgqsk\") pod \"maas-api-88c4c66b5-zxfjf\" (UID: \"1cd63fb5-8403-4717-8ffb-fa10ef72e4af\") " pod="odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf"
Sep 14 10:23:55.603070 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:55.603043    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1cd63fb5-8403-4717-8ffb-fa10ef72e4af-openshift-service-ca\") pod \"maas-api-88c4c66b5-zxfjf\" (UID: \"1cd63fb5-8403-4717-8ffb-fa10ef72e4af\") " pod="odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf"
Sep 14 10:23:55.604610 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:55.604587    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1cd63fb5-8403-4717-8ffb-fa10ef72e4af-metrics-certs\") pod \"maas-api-88c4c66b5-zxfjf\" (UID: \"1cd63fb5-8403-4717-8ffb-fa10ef72e4af\") " pod="odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf"
Sep 14 10:23:55.604692 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:55.604660    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1cd63fb5-8403-4717-8ffb-fa10ef72e4af-maas-api-tls\") pod \"maas-api-88c4c66b5-zxfjf\" (UID: \"1cd63fb5-8403-4717-8ffb-fa10ef72e4af\") " pod="odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf"
Sep 14 10:23:55.612885 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:55.612862    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgqsk\" (UniqueName: \"kubernetes.io/projected/1cd63fb5-8403-4717-8ffb-fa10ef72e4af-kube-api-access-kgqsk\") pod \"maas-api-88c4c66b5-zxfjf\" (UID: \"1cd63fb5-8403-4717-8ffb-fa10ef72e4af\") " pod="odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf"
Sep 14 10:23:55.749792 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:55.749692    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf"
Sep 14 10:23:56.026738 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:56.026691    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf"]
Sep 14 10:23:56.030360 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:23:56.030322    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cd63fb5_8403_4717_8ffb_fa10ef72e4af.slice/crio-4d5c100df4a76ef3789f28c2a15c922a2e8be6e9d577ac9e9fb74962fc1be826 WatchSource:0}: Error finding container 4d5c100df4a76ef3789f28c2a15c922a2e8be6e9d577ac9e9fb74962fc1be826: Status 404 returned error can't find the container with id 4d5c100df4a76ef3789f28c2a15c922a2e8be6e9d577ac9e9fb74962fc1be826
Sep 14 10:23:56.419140 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:56.419102    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf" event={"ID":"1cd63fb5-8403-4717-8ffb-fa10ef72e4af","Type":"ContainerStarted","Data":"d9744f6049b14e80d1bbb84befb91901d2e9ff4a94a2eac1133647c65d0a81ac"}
Sep 14 10:23:56.419540 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:56.419166    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf" event={"ID":"1cd63fb5-8403-4717-8ffb-fa10ef72e4af","Type":"ContainerStarted","Data":"4d5c100df4a76ef3789f28c2a15c922a2e8be6e9d577ac9e9fb74962fc1be826"}
Sep 14 10:23:56.419540 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:56.419323    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf"
Sep 14 10:23:56.438906 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:23:56.438851    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf" podStartSLOduration=1.147563886 podStartE2EDuration="1.438831275s" totalImagesPullingTime="291.267389ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-14 10:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:23:56.436984673 +0000 UTC m=+2452.295217067" watchObservedRunningTime="2026-09-14 10:23:56.438831275 +0000 UTC m=+2452.297063685"
Sep 14 10:24:01.695251 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:01.695207    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:24:02.429576 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:02.429547    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-88c4c66b5-zxfjf"
Sep 14 10:24:02.490927 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:02.490895    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"]
Sep 14 10:24:02.491143 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:02.491096    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5" podUID="893738dd-0720-458d-8ad5-b2b935dd1ddb" containerName="maas-api" containerID="cri-o://1a0d6f3e45dd94c96025ebec8df3af67847530ebaf8d708e5c801dbc1321d29c" gracePeriod=30
Sep 14 10:24:03.733046 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:03.733021    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"
Sep 14 10:24:03.882145 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:03.882062    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/893738dd-0720-458d-8ad5-b2b935dd1ddb-openshift-service-ca\") pod \"893738dd-0720-458d-8ad5-b2b935dd1ddb\" (UID: \"893738dd-0720-458d-8ad5-b2b935dd1ddb\") "
Sep 14 10:24:03.882145 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:03.882097    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/893738dd-0720-458d-8ad5-b2b935dd1ddb-metrics-certs\") pod \"893738dd-0720-458d-8ad5-b2b935dd1ddb\" (UID: \"893738dd-0720-458d-8ad5-b2b935dd1ddb\") "
Sep 14 10:24:03.882339 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:03.882151    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c964v\" (UniqueName: \"kubernetes.io/projected/893738dd-0720-458d-8ad5-b2b935dd1ddb-kube-api-access-c964v\") pod \"893738dd-0720-458d-8ad5-b2b935dd1ddb\" (UID: \"893738dd-0720-458d-8ad5-b2b935dd1ddb\") "
Sep 14 10:24:03.882339 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:03.882189    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/893738dd-0720-458d-8ad5-b2b935dd1ddb-maas-api-tls\") pod \"893738dd-0720-458d-8ad5-b2b935dd1ddb\" (UID: \"893738dd-0720-458d-8ad5-b2b935dd1ddb\") "
Sep 14 10:24:03.882541 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:03.882503    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/893738dd-0720-458d-8ad5-b2b935dd1ddb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "893738dd-0720-458d-8ad5-b2b935dd1ddb" (UID: "893738dd-0720-458d-8ad5-b2b935dd1ddb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 14 10:24:03.884317 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:03.884285    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/893738dd-0720-458d-8ad5-b2b935dd1ddb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "893738dd-0720-458d-8ad5-b2b935dd1ddb" (UID: "893738dd-0720-458d-8ad5-b2b935dd1ddb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:24:03.884437 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:03.884344    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/893738dd-0720-458d-8ad5-b2b935dd1ddb-kube-api-access-c964v" (OuterVolumeSpecName: "kube-api-access-c964v") pod "893738dd-0720-458d-8ad5-b2b935dd1ddb" (UID: "893738dd-0720-458d-8ad5-b2b935dd1ddb"). InnerVolumeSpecName "kube-api-access-c964v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 14 10:24:03.884437 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:03.884372    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/893738dd-0720-458d-8ad5-b2b935dd1ddb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "893738dd-0720-458d-8ad5-b2b935dd1ddb" (UID: "893738dd-0720-458d-8ad5-b2b935dd1ddb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 14 10:24:03.983055 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:03.983022    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/893738dd-0720-458d-8ad5-b2b935dd1ddb-openshift-service-ca\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:24:03.983055 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:03.983048    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/893738dd-0720-458d-8ad5-b2b935dd1ddb-metrics-certs\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:24:03.983055 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:03.983058    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c964v\" (UniqueName: \"kubernetes.io/projected/893738dd-0720-458d-8ad5-b2b935dd1ddb-kube-api-access-c964v\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:24:03.983281 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:03.983067    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/893738dd-0720-458d-8ad5-b2b935dd1ddb-maas-api-tls\") on node \"ip-10-0-132-247.ec2.internal\" DevicePath \"\""
Sep 14 10:24:04.457550 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:04.457512    2581 generic.go:356] "Generic (PLEG): container finished" podID="893738dd-0720-458d-8ad5-b2b935dd1ddb" containerID="1a0d6f3e45dd94c96025ebec8df3af67847530ebaf8d708e5c801dbc1321d29c" exitCode=0
Sep 14 10:24:04.457751 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:04.457553    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"
Sep 14 10:24:04.457751 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:04.457579    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5" event={"ID":"893738dd-0720-458d-8ad5-b2b935dd1ddb","Type":"ContainerDied","Data":"1a0d6f3e45dd94c96025ebec8df3af67847530ebaf8d708e5c801dbc1321d29c"}
Sep 14 10:24:04.457751 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:04.457655    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5" event={"ID":"893738dd-0720-458d-8ad5-b2b935dd1ddb","Type":"ContainerDied","Data":"66e60d585cc66e02ec596813410945241e309f8fd154a45b844cdf255e56d84d"}
Sep 14 10:24:04.457751 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:04.457679    2581 scope.go:117] "RemoveContainer" containerID="1a0d6f3e45dd94c96025ebec8df3af67847530ebaf8d708e5c801dbc1321d29c"
Sep 14 10:24:04.467219 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:04.467199    2581 scope.go:117] "RemoveContainer" containerID="1a0d6f3e45dd94c96025ebec8df3af67847530ebaf8d708e5c801dbc1321d29c"
Sep 14 10:24:04.467490 ip-10-0-132-247 kubenswrapper[2581]: E0914 10:24:04.467472    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a0d6f3e45dd94c96025ebec8df3af67847530ebaf8d708e5c801dbc1321d29c\": container with ID starting with 1a0d6f3e45dd94c96025ebec8df3af67847530ebaf8d708e5c801dbc1321d29c not found: ID does not exist" containerID="1a0d6f3e45dd94c96025ebec8df3af67847530ebaf8d708e5c801dbc1321d29c"
Sep 14 10:24:04.467538 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:04.467501    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a0d6f3e45dd94c96025ebec8df3af67847530ebaf8d708e5c801dbc1321d29c"} err="failed to get container status \"1a0d6f3e45dd94c96025ebec8df3af67847530ebaf8d708e5c801dbc1321d29c\": rpc error: code = NotFound desc = could not find container \"1a0d6f3e45dd94c96025ebec8df3af67847530ebaf8d708e5c801dbc1321d29c\": container with ID starting with 1a0d6f3e45dd94c96025ebec8df3af67847530ebaf8d708e5c801dbc1321d29c not found: ID does not exist"
Sep 14 10:24:04.481366 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:04.481340    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"]
Sep 14 10:24:04.486937 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:04.486910    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-769969ccd5-xhgj5"]
Sep 14 10:24:04.658352 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:04.658314    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="893738dd-0720-458d-8ad5-b2b935dd1ddb" path="/var/lib/kubelet/pods/893738dd-0720-458d-8ad5-b2b935dd1ddb/volumes"
Sep 14 10:24:07.605698 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:07.605664    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:24:14.176324 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:14.176284    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-zzk2n"]
Sep 14 10:24:22.576765 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:22.576733    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-5dqmt_aece210a-f788-4bdc-9ee6-b59b5efb7ce4/manager/0.log"
Sep 14 10:24:22.690857 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:22.690819    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-tzmc6_f23217c7-4cdb-421e-94c9-83774066aed7/manager/0.log"
Sep 14 10:24:22.808601 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:22.808567    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6dfbdc546b-cq6f6_e3d60fa7-4ce2-4ea9-95b3-9995d5743658/manager/0.log"
Sep 14 10:24:23.304340 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:23.304313    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84fdd9869c-5t7b9_11191c17-2403-4f1a-a5b6-b9ae9fbd965f/copy-manifests/0.log"
Sep 14 10:24:23.315572 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:23.315544    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84fdd9869c-5t7b9_11191c17-2403-4f1a-a5b6-b9ae9fbd965f/manager/0.log"
Sep 14 10:24:23.917390 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:23.917357    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-88c4c66b5-zxfjf_1cd63fb5-8403-4717-8ffb-fa10ef72e4af/maas-api/0.log"
Sep 14 10:24:25.148828 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:25.148786    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-pctnh_3c84466f-4ed3-4209-8999-4d0cd4f17b80/manager/0.log"
Sep 14 10:24:25.254821 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:25.254755    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-4j76h_8a0e8f11-0743-4779-835b-86a6a40d1e09/manager/0.log"
Sep 14 10:24:25.363357 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:25.363325    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-7nl57_e3c98b92-1b4e-4656-a285-9ab2b65e5b17/kuadrant-console-plugin/0.log"
Sep 14 10:24:25.615780 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:25.615753    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-zzk2n_886a10ce-b188-4cda-a0fc-e0195ef605db/limitador/0.log"
Sep 14 10:24:25.737973 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:25.737943    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-d8w4t_b753abb4-856b-4525-9ae4-a061611f90d2/manager/0.log"
Sep 14 10:24:26.422764 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:26.422732    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65d9bcd789-cl6d4_12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942/kube-auth-proxy/0.log"
Sep 14 10:24:26.537080 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:26.537050    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w9vt5_58f012c5-1b30-4c57-91dc-8d94ff3f7ee8/istio-proxy/1.log"
Sep 14 10:24:26.773514 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:26.773483    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-jtl9g_e9fb2c13-a823-4d31-8633-e79a2affba2d/payload-processing/0.log"
Sep 14 10:24:26.880871 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:26.880837    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-858c855598-jhg2x_ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd/router/0.log"
Sep 14 10:24:27.443067 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:27.443032    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-8fbfg_bc544e0a-105e-4723-b2ef-6e865cfb8b4b/main/0.log"
Sep 14 10:24:27.670618 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:27.670590    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvs98_efbef168-639f-467f-9c94-815b442de5a8/main/0.log"
Sep 14 10:24:27.779097 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:27.779010    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-4979g_5bc1859e-7308-4619-bde2-66b4a0de4319/main/0.log"
Sep 14 10:24:27.896014 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:27.895986    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-dqc6f_e4fb5fff-5b56-4cc1-aaa9-50dc23056cf4/main/0.log"
Sep 14 10:24:36.848919 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:36.848886    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4rsn7_684f63fb-ee2f-41ac-a26b-759fa9c2d043/global-pull-secret-syncer/0.log"
Sep 14 10:24:37.106475 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:37.106390    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pnznq_7e4bd39b-b3ae-4b10-ad3a-67c87e399fed/konnectivity-agent/0.log"
Sep 14 10:24:37.131265 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:37.131237    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-247.ec2.internal_4c9742fcc68c982c9ec23fd7b6742875/haproxy/0.log"
Sep 14 10:24:41.923915 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:41.923886    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-pctnh_3c84466f-4ed3-4209-8999-4d0cd4f17b80/manager/0.log"
Sep 14 10:24:41.953540 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:41.953512    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-4j76h_8a0e8f11-0743-4779-835b-86a6a40d1e09/manager/0.log"
Sep 14 10:24:41.986846 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:41.986818    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-7nl57_e3c98b92-1b4e-4656-a285-9ab2b65e5b17/kuadrant-console-plugin/0.log"
Sep 14 10:24:42.066570 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:42.066541    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-zzk2n_886a10ce-b188-4cda-a0fc-e0195ef605db/limitador/0.log"
Sep 14 10:24:42.124210 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:42.124182    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-d8w4t_b753abb4-856b-4525-9ae4-a061611f90d2/manager/0.log"
Sep 14 10:24:44.098304 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:44.098267    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hl94r_8e263423-fd60-485c-86ab-0f5ddd78a18e/node-exporter/0.log"
Sep 14 10:24:44.123089 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:44.123064    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hl94r_8e263423-fd60-485c-86ab-0f5ddd78a18e/kube-rbac-proxy/0.log"
Sep 14 10:24:44.148084 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:44.148060    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hl94r_8e263423-fd60-485c-86ab-0f5ddd78a18e/init-textfile/0.log"
Sep 14 10:24:44.620457 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:44.620380    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-vk9x5_92386275-cf0f-4ac9-a28d-fbfbe73481dd/prometheus-operator/0.log"
Sep 14 10:24:44.652692 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:44.652658    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-vk9x5_92386275-cf0f-4ac9-a28d-fbfbe73481dd/kube-rbac-proxy/0.log"
Sep 14 10:24:46.297453 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:46.297425    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-npw7b_0c1229e7-9521-4b30-a1e3-09db80859a19/networking-console-plugin/0.log"
Sep 14 10:24:47.015269 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.015224    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"]
Sep 14 10:24:47.016068 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.016045    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="893738dd-0720-458d-8ad5-b2b935dd1ddb" containerName="maas-api"
Sep 14 10:24:47.016068 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.016069    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="893738dd-0720-458d-8ad5-b2b935dd1ddb" containerName="maas-api"
Sep 14 10:24:47.016250 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.016237    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="893738dd-0720-458d-8ad5-b2b935dd1ddb" containerName="maas-api"
Sep 14 10:24:47.019975 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.019952    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"
Sep 14 10:24:47.022893 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.022871    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dhktf\"/\"openshift-service-ca.crt\""
Sep 14 10:24:47.024322 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.024296    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dhktf\"/\"default-dockercfg-7kn6x\""
Sep 14 10:24:47.024432 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.024338    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dhktf\"/\"kube-root-ca.crt\""
Sep 14 10:24:47.027265 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.027234    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"]
Sep 14 10:24:47.190036 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.189996    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2ada5f4b-cff9-43a9-9bf5-d600af0f5a68-podres\") pod \"perf-node-gather-daemonset-7zw9f\" (UID: \"2ada5f4b-cff9-43a9-9bf5-d600af0f5a68\") " pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"
Sep 14 10:24:47.190251 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.190064    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ada5f4b-cff9-43a9-9bf5-d600af0f5a68-sys\") pod \"perf-node-gather-daemonset-7zw9f\" (UID: \"2ada5f4b-cff9-43a9-9bf5-d600af0f5a68\") " pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"
Sep 14 10:24:47.190251 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.190153    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2ada5f4b-cff9-43a9-9bf5-d600af0f5a68-proc\") pod \"perf-node-gather-daemonset-7zw9f\" (UID: \"2ada5f4b-cff9-43a9-9bf5-d600af0f5a68\") " pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"
Sep 14 10:24:47.190251 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.190241    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ada5f4b-cff9-43a9-9bf5-d600af0f5a68-lib-modules\") pod \"perf-node-gather-daemonset-7zw9f\" (UID: \"2ada5f4b-cff9-43a9-9bf5-d600af0f5a68\") " pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"
Sep 14 10:24:47.190410 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.190281    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcpmd\" (UniqueName: \"kubernetes.io/projected/2ada5f4b-cff9-43a9-9bf5-d600af0f5a68-kube-api-access-jcpmd\") pod \"perf-node-gather-daemonset-7zw9f\" (UID: \"2ada5f4b-cff9-43a9-9bf5-d600af0f5a68\") " pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"
Sep 14 10:24:47.291553 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.291454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2ada5f4b-cff9-43a9-9bf5-d600af0f5a68-proc\") pod \"perf-node-gather-daemonset-7zw9f\" (UID: \"2ada5f4b-cff9-43a9-9bf5-d600af0f5a68\") " pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"
Sep 14 10:24:47.291553 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.291534    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ada5f4b-cff9-43a9-9bf5-d600af0f5a68-lib-modules\") pod \"perf-node-gather-daemonset-7zw9f\" (UID: \"2ada5f4b-cff9-43a9-9bf5-d600af0f5a68\") " pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"
Sep 14 10:24:47.291846 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.291570    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcpmd\" (UniqueName: \"kubernetes.io/projected/2ada5f4b-cff9-43a9-9bf5-d600af0f5a68-kube-api-access-jcpmd\") pod \"perf-node-gather-daemonset-7zw9f\" (UID: \"2ada5f4b-cff9-43a9-9bf5-d600af0f5a68\") " pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"
Sep 14 10:24:47.291846 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.291596    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2ada5f4b-cff9-43a9-9bf5-d600af0f5a68-proc\") pod \"perf-node-gather-daemonset-7zw9f\" (UID: \"2ada5f4b-cff9-43a9-9bf5-d600af0f5a68\") " pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"
Sep 14 10:24:47.291846 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.291624    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2ada5f4b-cff9-43a9-9bf5-d600af0f5a68-podres\") pod \"perf-node-gather-daemonset-7zw9f\" (UID: \"2ada5f4b-cff9-43a9-9bf5-d600af0f5a68\") " pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"
Sep 14 10:24:47.291846 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.291666    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ada5f4b-cff9-43a9-9bf5-d600af0f5a68-sys\") pod \"perf-node-gather-daemonset-7zw9f\" (UID: \"2ada5f4b-cff9-43a9-9bf5-d600af0f5a68\") " pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"
Sep 14 10:24:47.291846 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.291762    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ada5f4b-cff9-43a9-9bf5-d600af0f5a68-lib-modules\") pod \"perf-node-gather-daemonset-7zw9f\" (UID: \"2ada5f4b-cff9-43a9-9bf5-d600af0f5a68\") " pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"
Sep 14 10:24:47.291846 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.291791    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ada5f4b-cff9-43a9-9bf5-d600af0f5a68-sys\") pod \"perf-node-gather-daemonset-7zw9f\" (UID: \"2ada5f4b-cff9-43a9-9bf5-d600af0f5a68\") " pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"
Sep 14 10:24:47.291846 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.291812    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2ada5f4b-cff9-43a9-9bf5-d600af0f5a68-podres\") pod \"perf-node-gather-daemonset-7zw9f\" (UID: \"2ada5f4b-cff9-43a9-9bf5-d600af0f5a68\") " pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"
Sep 14 10:24:47.302417 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.302392    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcpmd\" (UniqueName: \"kubernetes.io/projected/2ada5f4b-cff9-43a9-9bf5-d600af0f5a68-kube-api-access-jcpmd\") pod \"perf-node-gather-daemonset-7zw9f\" (UID: \"2ada5f4b-cff9-43a9-9bf5-d600af0f5a68\") " pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"
Sep 14 10:24:47.331403 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.331368    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"
Sep 14 10:24:47.604551 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.604464    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"]
Sep 14 10:24:47.607695 ip-10-0-132-247 kubenswrapper[2581]: W0914 10:24:47.607652    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2ada5f4b_cff9_43a9_9bf5_d600af0f5a68.slice/crio-f0d3ebad6c2963adb3afbe6e4f02ee048bcfe493a300738751d967f25e5cf001 WatchSource:0}: Error finding container f0d3ebad6c2963adb3afbe6e4f02ee048bcfe493a300738751d967f25e5cf001: Status 404 returned error can't find the container with id f0d3ebad6c2963adb3afbe6e4f02ee048bcfe493a300738751d967f25e5cf001
Sep 14 10:24:47.638644 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.638624    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f9d4ddc7f-sr876_1e6180cf-888b-49fa-9c60-121d596a979e/console/0.log"
Sep 14 10:24:47.672931 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:47.672904    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f" event={"ID":"2ada5f4b-cff9-43a9-9bf5-d600af0f5a68","Type":"ContainerStarted","Data":"f0d3ebad6c2963adb3afbe6e4f02ee048bcfe493a300738751d967f25e5cf001"}
Sep 14 10:24:48.678746 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:48.678688    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f" event={"ID":"2ada5f4b-cff9-43a9-9bf5-d600af0f5a68","Type":"ContainerStarted","Data":"2093f2c7dfc7a626c119d14a557c390b22041a365144f4e96ab4f6dc9e7a4232"}
Sep 14 10:24:48.679144 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:48.678828    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"
Sep 14 10:24:48.695557 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:48.695509    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f" podStartSLOduration=2.695494837 podStartE2EDuration="2.695494837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-14 10:24:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-14 10:24:48.694942267 +0000 UTC m=+2504.553174623" watchObservedRunningTime="2026-09-14 10:24:48.695494837 +0000 UTC m=+2504.553727194"
Sep 14 10:24:49.624518 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:49.624482    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6zmdn_59ba9674-e083-4b6a-b47b-8bf88d0f926c/dns/0.log"
Sep 14 10:24:49.648244 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:49.648216    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6zmdn_59ba9674-e083-4b6a-b47b-8bf88d0f926c/kube-rbac-proxy/0.log"
Sep 14 10:24:49.838170 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:49.838129    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k4h57_af3b9fa5-b5eb-41b5-b21f-c3983847fb50/dns-node-resolver/0.log"
Sep 14 10:24:50.421820 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:50.421790    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c2bz4_66a14d90-706e-47be-b9bb-2adeb65103bf/node-ca/0.log"
Sep 14 10:24:52.375969 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:52.375943    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65d9bcd789-cl6d4_12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942/kube-auth-proxy/0.log"
Sep 14 10:24:52.414997 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:52.414953    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w9vt5_58f012c5-1b30-4c57-91dc-8d94ff3f7ee8/istio-proxy/0.log"
Sep 14 10:24:52.417565 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:52.417539    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w9vt5_58f012c5-1b30-4c57-91dc-8d94ff3f7ee8/istio-proxy/1.log"
Sep 14 10:24:52.500097 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:52.500069    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-jtl9g_e9fb2c13-a823-4d31-8633-e79a2affba2d/payload-processing/0.log"
Sep 14 10:24:52.525511 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:52.525491    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-858c855598-jhg2x_ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd/router/0.log"
Sep 14 10:24:53.523117 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:53.523086    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rblrn_bb79a7dc-bd40-4f24-b163-973dc14c0cb4/serve-healthcheck-canary/0.log"
Sep 14 10:24:54.025773 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:54.025738    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-zst5h_977c6b7b-d8e8-4b0d-b312-163d6fee715a/insights-operator/0.log"
Sep 14 10:24:54.026136 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:54.026116    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-zst5h_977c6b7b-d8e8-4b0d-b312-163d6fee715a/insights-operator/1.log"
Sep 14 10:24:54.051590 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:54.051564    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k9b5v_5d7cbfd3-b21a-474f-8dda-bf49fd28bc63/kube-rbac-proxy/0.log"
Sep 14 10:24:54.077260 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:54.077230    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k9b5v_5d7cbfd3-b21a-474f-8dda-bf49fd28bc63/exporter/0.log"
Sep 14 10:24:54.103811 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:54.103778    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k9b5v_5d7cbfd3-b21a-474f-8dda-bf49fd28bc63/extractor/0.log"
Sep 14 10:24:54.694166 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:54.694139    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dhktf/perf-node-gather-daemonset-7zw9f"
Sep 14 10:24:56.498580 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:56.498548    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-5dqmt_aece210a-f788-4bdc-9ee6-b59b5efb7ce4/manager/0.log"
Sep 14 10:24:56.761160 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:56.761055    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-tzmc6_f23217c7-4cdb-421e-94c9-83774066aed7/manager/0.log"
Sep 14 10:24:56.811299 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:56.811269    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6dfbdc546b-cq6f6_e3d60fa7-4ce2-4ea9-95b3-9995d5743658/manager/0.log"
Sep 14 10:24:57.064538 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:57.064432    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84fdd9869c-5t7b9_11191c17-2403-4f1a-a5b6-b9ae9fbd965f/manager/0.log"
Sep 14 10:24:57.090426 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:57.090396    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84fdd9869c-5t7b9_11191c17-2403-4f1a-a5b6-b9ae9fbd965f/copy-manifests/0.log"
Sep 14 10:24:58.758841 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:58.758812    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65d9bcd789-cl6d4_12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942/kube-auth-proxy/0.log"
Sep 14 10:24:58.781761 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:58.781726    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w9vt5_58f012c5-1b30-4c57-91dc-8d94ff3f7ee8/istio-proxy/0.log"
Sep 14 10:24:58.784369 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:58.784349    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w9vt5_58f012c5-1b30-4c57-91dc-8d94ff3f7ee8/istio-proxy/1.log"
Sep 14 10:24:58.840397 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:58.840366    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-jtl9g_e9fb2c13-a823-4d31-8633-e79a2affba2d/payload-processing/0.log"
Sep 14 10:24:58.858600 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:24:58.858574    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-858c855598-jhg2x_ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd/router/0.log"
Sep 14 10:25:01.286575 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:25:01.286545    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65d9bcd789-cl6d4_12c9b3fe-aaf8-4f7c-bfe8-1afb6b57a942/kube-auth-proxy/0.log"
Sep 14 10:25:01.309492 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:25:01.309460    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w9vt5_58f012c5-1b30-4c57-91dc-8d94ff3f7ee8/istio-proxy/0.log"
Sep 14 10:25:01.312073 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:25:01.312050    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w9vt5_58f012c5-1b30-4c57-91dc-8d94ff3f7ee8/istio-proxy/1.log"
Sep 14 10:25:01.371909 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:25:01.371877    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-jtl9g_e9fb2c13-a823-4d31-8633-e79a2affba2d/payload-processing/0.log"
Sep 14 10:25:01.386073 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:25:01.386045    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-858c855598-jhg2x_ce6f1ffd-ab92-4cde-ab15-ba7ec9200dfd/router/0.log"
Sep 14 10:25:04.522809 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:25:04.522779    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-wnntw_bafdd1e7-cf34-4b63-9d55-9f5785b01ea3/kube-storage-version-migrator-operator/1.log"
Sep 14 10:25:04.523702 ip-10-0-132-247 kubenswrapper[2581]: I0914 10:25:04.523681    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-wnntw_bafdd1e7-cf34-4b63-9d55-9f5785b01ea3/kube-storage-version-migrator-operator/0.log"